-- Logs begin at Sat 2021-08-07 04:15:41 UTC, end at Sat 2021-08-07 05:21:43 UTC. -- Aug 07 04:45:27.413887 dv-cinder-803748-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 07 04:45:27.423923 dv-cinder-803748-3-iscsi devstack@n-api.service[92559]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 07 04:45:27.424477 dv-cinder-803748-3-iscsi devstack@n-api.service[92559]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Aug 7 04:45:27 2021] *** Aug 07 04:45:27.424477 dv-cinder-803748-3-iscsi devstack@n-api.service[92559]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 07 04:45:27.424477 dv-cinder-803748-3-iscsi devstack@n-api.service[92559]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 07 04:45:27.424477 dv-cinder-803748-3-iscsi devstack@n-api.service[92559]: nodename: dv-cinder-803748-3-iscsi Aug 07 04:45:27.424477 dv-cinder-803748-3-iscsi devstack@n-api.service[92559]: machine: x86_64 Aug 07 04:45:27.424477 dv-cinder-803748-3-iscsi devstack@n-api.service[92559]: clock source: unix Aug 07 04:45:27.424477 dv-cinder-803748-3-iscsi devstack@n-api.service[92559]: pcre jit disabled Aug 07 04:45:27.424477 dv-cinder-803748-3-iscsi devstack@n-api.service[92559]: detected number of CPU cores: 4 Aug 07 04:45:27.424477 dv-cinder-803748-3-iscsi devstack@n-api.service[92559]: current working directory: / Aug 07 04:45:27.424477 dv-cinder-803748-3-iscsi devstack@n-api.service[92559]: detected binary path: /usr/bin/uwsgi-core Aug 07 04:45:27.424477 dv-cinder-803748-3-iscsi devstack@n-api.service[92559]: your processes number limit is 47680 Aug 07 04:45:27.424477 dv-cinder-803748-3-iscsi devstack@n-api.service[92559]: your memory page size is 4096 bytes Aug 07 04:45:27.424477 dv-cinder-803748-3-iscsi devstack@n-api.service[92559]: detected max file descriptor number: 2048 Aug 07 04:45:27.424477 dv-cinder-803748-3-iscsi devstack@n-api.service[92559]: lock engine: pthread robust mutexes Aug 07 04:45:27.424477 dv-cinder-803748-3-iscsi devstack@n-api.service[92559]: thunder lock: enabled Aug 07 04:45:27.424477 dv-cinder-803748-3-iscsi devstack@n-api.service[92559]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 07 04:45:27.425397 dv-cinder-803748-3-iscsi devstack@n-api.service[92559]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Aug 07 04:45:27.469111 dv-cinder-803748-3-iscsi devstack@n-api.service[92559]: Python main interpreter initialized at 0x55b85e33d9c0 Aug 07 04:45:27.469111 dv-cinder-803748-3-iscsi devstack@n-api.service[92559]: python threads support enabled Aug 07 04:45:27.469111 dv-cinder-803748-3-iscsi devstack@n-api.service[92559]: your server socket listen backlog is limited to 100 connections Aug 07 04:45:27.469111 dv-cinder-803748-3-iscsi devstack@n-api.service[92559]: your mercy for graceful operations on workers is 90 seconds Aug 07 04:45:27.469735 dv-cinder-803748-3-iscsi devstack@n-api.service[92559]: mapped 403077 bytes (393 KB) for 2 cores Aug 07 04:45:27.469812 dv-cinder-803748-3-iscsi devstack@n-api.service[92559]: *** Operational MODE: preforking *** Aug 07 04:45:27.470030 dv-cinder-803748-3-iscsi devstack@n-api.service[92559]: *** uWSGI is running in multiple interpreter mode *** Aug 07 04:45:27.470030 dv-cinder-803748-3-iscsi devstack@n-api.service[92559]: spawned uWSGI master process (pid: 92559) Aug 07 04:45:27.470224 dv-cinder-803748-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 07 04:45:27.471577 dv-cinder-803748-3-iscsi devstack@n-api.service[92559]: spawned uWSGI worker 1 (pid: 92560, cores: 1) Aug 07 04:45:27.471577 dv-cinder-803748-3-iscsi devstack@n-api.service[92559]: spawned uWSGI worker 2 (pid: 92561, cores: 1) Aug 07 04:45:27.471577 dv-cinder-803748-3-iscsi devstack@n-api.service[92559]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 07 04:45:29.107570 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 04:45:29.107570 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: from cryptography.utils import int_from_bytes Aug 07 04:45:29.108238 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 04:45:29.108238 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: from cryptography.utils import int_from_bytes Aug 07 04:45:29.110062 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 04:45:29.110062 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: from cryptography.utils import int_from_bytes Aug 07 04:45:29.110570 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 04:45:29.110570 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: from cryptography.utils import int_from_bytes Aug 07 04:45:31.771000 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 07 04:45:31.771544 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 07 04:45:31.771733 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 07 04:45:31.772083 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 07 04:45:31.772332 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 07 04:45:31.772712 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.773058 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.773372 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.773457 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 07 04:45:31.773847 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 07 04:45:31.773931 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.774009 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.774085 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 07 04:45:31.774277 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.774422 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 07 04:45:31.774587 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.774672 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 07 04:45:31.774899 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.775048 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.775218 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.775372 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.775465 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.775689 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.775784 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.776006 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.776099 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-803748-3-iscsi {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.776333 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.776423 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.776641 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.776732 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.776966 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.777073 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.777277 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.777361 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.777573 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.777657 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.777852 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.777937 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.778166 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.778252 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.778488 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-803748-3-iscsi {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.778649 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.778805 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.779079 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.779189 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.779382 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.779491 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.779687 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.779794 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.780009 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.780142 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.780294 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.780427 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.780596 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.780691 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.780930 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.781127 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.781223 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.781432 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.781526 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.781736 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.781828 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.782050 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.782197 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-803748-3-iscsi {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.782383 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.782507 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.782693 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.782813 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.783000 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.783120 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.783316 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.783524 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.783616 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.783828 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.783924 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.784130 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.784214 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.784444 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.784581 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-803748-3-iscsi {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.784759 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.784903 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.785082 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.785208 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.785400 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.785529 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.785712 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.785908 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.786006 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.786217 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.786303 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.786522 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.786607 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.786838 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.786938 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.787698 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.787838 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.788008 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.788109 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.788328 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.788417 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.788591 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.788679 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.788855 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.788946 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.789158 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.789253 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.789471 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.789562 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.789784 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.789869 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.790099 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.790200 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.790343 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.790478 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.790588 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.790760 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.790898 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.790985 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.791210 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.791296 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.791511 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.791612 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.791807 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.791892 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.792103 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.792188 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.792401 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.792494 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.792669 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.792755 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.792942 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.793040 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.793259 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.793346 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.793571 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.793666 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.793871 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.793956 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.794171 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.794255 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.794470 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.794555 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.794770 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.794856 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.795072 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.795157 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.795373 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.795465 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.35 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.795674 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.795759 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.35 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.795969 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.796053 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.796278 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.796362 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.796586 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.796679 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.796905 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.796994 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.797217 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.797301 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.797527 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.797622 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.797831 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.797936 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.35 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.798135 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.798229 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.35 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.798432 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.798541 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.798742 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.798842 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.799058 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.799150 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.799350 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.799454 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.799596 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.799694 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.799887 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.799972 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.800184 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.800317 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.800489 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.800622 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.800795 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.800883 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.801103 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.801190 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.801399 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.801484 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.801690 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.801776 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.801980 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.802066 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.802275 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.802358 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.802569 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.802661 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.803429 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.803607 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.803830 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.803926 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.804005 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.804082 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.804277 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.804365 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.804570 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.804653 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.804885 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.804987 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.805187 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.805279 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.805488 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.805572 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.805785 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.805877 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.806082 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.806166 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.806373 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.806456 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.806670 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.806766 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.806969 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.807064 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.807261 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.807345 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.807558 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.807652 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.807870 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.807955 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.808164 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.808247 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.808459 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.808557 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.808756 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.808875 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.809076 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.809160 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.809374 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.809474 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.809673 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.809758 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.809962 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.810047 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.810264 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.810395 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.810562 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.810672 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.810855 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.810942 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.811151 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.811246 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.811445 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.811530 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.811738 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.811822 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.812033 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.812127 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.812328 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.812419 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.812620 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.812756 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.812938 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.813029 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.813230 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.813317 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.813529 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.813613 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.813829 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.813922 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.814126 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.814210 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.814422 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.814505 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.814716 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.814801 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.815011 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.815096 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.815312 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.815398 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.815608 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.815695 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.815920 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.816012 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.816237 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.816330 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.816590 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.816693 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.816862 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.816962 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.817168 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.817329 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.817483 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:45:31.817568 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.817786 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.817870 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.818109 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.818205 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.818442 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.818536 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.818749 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.818841 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.819056 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.819186 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.819367 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.819518 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.819679 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.819837 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.820001 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.820149 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.820365 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.820461 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.820614 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.820772 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.820951 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.821105 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.821256 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.821417 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.821566 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.821726 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.821886 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.822043 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.822201 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.822365 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.822501 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.822692 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.822825 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.823007 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.823159 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.823320 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.823468 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.823639 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.823786 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.823948 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.824091 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.824265 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.824405 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.824590 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.824711 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.824933 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.825031 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.825243 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.825328 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.825582 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.825678 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.825917 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.826003 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.826221 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.826348 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.826541 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.826626 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.826845 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.826929 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.827154 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.827239 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.827454 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.827540 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.827752 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.827837 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.828055 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.828141 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.828357 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.828443 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.828654 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.828739 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.828987 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.829084 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.829306 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.829403 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.829608 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.829694 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.829922 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.830015 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.830220 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.830304 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.830522 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.830617 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.830820 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.830961 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.831120 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.831215 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.831417 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.831503 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.831719 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.831816 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.832019 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.832106 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.832334 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.832419 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.832639 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.832734 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.832977 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.833073 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.833287 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.833381 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.833595 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.833682 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.833896 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.834019 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.834286 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.834373 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.834663 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.834750 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.834969 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.835055 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.835274 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.835365 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.835591 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.835678 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.835891 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.835975 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.836194 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.836279 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.836496 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.836590 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.836815 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.836914 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.837137 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.837229 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.837449 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.837548 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.837759 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.837845 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.838067 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.838160 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.838363 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.838448 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.838667 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.838751 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.838964 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.839057 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.839261 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.839353 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.839557 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.839642 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.839856 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.840016 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.840153 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.840239 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.840451 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.840551 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.840750 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.840914 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.841068 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.841164 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.841364 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.841457 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.841678 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.841765 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.841979 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.842065 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.842273 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.842358 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.842570 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.842657 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.842865 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.842951 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.843165 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.843248 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.843468 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.843561 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.843770 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.843856 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.844072 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.844163 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.844645 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.844733 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.844981 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.845068 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.845282 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.845365 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.845579 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.845666 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.845876 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.845959 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.846177 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.846269 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.846493 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.846579 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.846791 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.846877 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.847096 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.847194 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.847394 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.847541 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.847699 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.847785 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.848016 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.848108 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.848321 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.848407 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.848624 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.848714 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.848948 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.849052 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.849265 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.849350 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.849563 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.850151 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.850384 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.850477 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.850688 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.850956 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.851053 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.851267 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.851363 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.851568 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.851660 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.851874 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.851960 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.852177 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.852274 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.852478 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.852564 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.852774 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.852890 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.853102 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.853240 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.853402 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.853495 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.853700 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.853787 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.853994 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.854089 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.854296 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.854381 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.854601 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.854692 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.854900 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.854993 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.855207 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.855291 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.855515 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.855599 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.855808 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.855893 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.856101 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.856195 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.856406 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.856490 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.856703 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.856809 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.857022 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.857108 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.857317 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.857415 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.857612 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.857700 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.857931 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.858015 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.858236 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.858320 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.858539 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.858632 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.858839 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.858923 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.859140 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.859232 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.859440 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.859532 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.859746 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.859832 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.860044 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.860136 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.860343 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.860428 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.860641 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.860724 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.860980 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.861089 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.861280 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.861367 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.861583 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.861668 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.861884 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.861977 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.862185 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.862271 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.862487 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.862572 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.862794 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.862888 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.863092 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.863177 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.863394 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.863482 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.863694 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.863781 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.863987 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.864072 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.864288 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.864374 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.864638 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.864732 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.864939 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.865176 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.865301 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.866174 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.866407 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.866496 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.866653 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.866785 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.866908 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.867097 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.867222 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.867411 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.867533 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.867736 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.867822 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.868059 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.868146 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.868366 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.868451 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.868669 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.868995 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.869097 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.869295 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.869385 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.869594 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.869680 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.869896 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.870064 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.870194 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.870280 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.870491 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.870598 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.870786 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.870926 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.871089 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.871256 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.871392 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.871566 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.871704 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.871870 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.871963 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.872177 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.872262 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.872480 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.872573 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.872783 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.872883 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.873121 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.873215 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.873414 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.873507 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.873716 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.873799 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.874017 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.874102 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.874314 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.874408 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.874609 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.874695 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.874904 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.874988 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.875204 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.875298 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.875508 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.875594 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.875822 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.875907 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.876125 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.876212 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.876435 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.876527 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.876738 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.876883 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.877060 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.877148 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.877377 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.877463 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.877675 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.877767 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.877972 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.878058 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.878266 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.878351 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.878573 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.878664 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.878873 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.878960 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.879168 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.879253 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.879478 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.879577 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.879778 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.879873 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.880078 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.880165 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.880378 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.880463 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.880671 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.880769 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.881019 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.881108 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.881317 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.881514 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.881609 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.881825 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.881911 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.882135 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.882220 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.882445 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.882539 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.882748 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.882833 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.883043 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.883128 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.883337 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.883430 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.883636 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.883732 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.883929 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.884016 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.884235 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.884321 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.884534 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.884621 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.884850 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.884939 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.885147 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.885232 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.885449 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.885544 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.885748 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.885832 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.886038 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.886129 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.886342 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.886428 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.886643 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.886735 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.886940 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.887032 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.887242 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.887328 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.887538 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.887631 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.887828 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.887924 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.888130 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.888216 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.888427 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.888510 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.888729 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.888841 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.889054 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.889146 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.889358 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.889442 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.889652 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.889744 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.889949 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.890034 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.890246 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.890333 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.890546 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.890644 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.890844 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.890929 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.891140 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.891226 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.891434 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.891532 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.891730 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.891814 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.892024 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.892109 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.892337 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.892430 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.892634 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.892720 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.892952 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.893039 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.893251 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.893340 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.893546 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.893633 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.893844 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.893929 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.894149 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.894236 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.894451 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.894536 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.894750 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.894836 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.895048 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.895140 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.895347 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.895439 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.895644 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.895736 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.895946 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.896032 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.896253 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.896344 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.897097 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.897211 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.897466 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.897578 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.897774 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.897883 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.898082 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.898226 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.898381 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.898530 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.898679 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.898884 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.898998 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.899190 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.899301 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.899502 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.899595 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.899820 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.899912 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.900129 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.900218 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.900440 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.900532 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.900752 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.900864 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.901079 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.901173 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.901381 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.901512 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.901682 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.901778 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.901986 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.902089 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.902285 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.902371 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.902585 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.902678 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.902887 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.902973 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.903190 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.903275 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.903491 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.903585 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.903792 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.903878 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.904091 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.904176 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.904394 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.904489 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.904695 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.904781 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.905017 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.905104 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.905323 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.905410 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.905623 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.905707 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.905918 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.906004 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.906223 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.906309 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.906519 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.906611 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.906823 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.906908 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.907121 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.907214 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.907423 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.907538 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.907731 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.907841 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.908035 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.908129 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.908344 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.908429 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.908651 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.908749 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.908994 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.909082 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.909318 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.909412 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.909623 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.909717 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.909921 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.910014 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.910228 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.910342 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.910532 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.910650 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.910841 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.910954 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.911145 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.911258 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.911558 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.911651 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.911855 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.911952 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.912199 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.912313 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.912520 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.912637 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.912841 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.912978 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.913145 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.913291 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.913442 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.913609 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.913759 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.913931 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.914057 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.914238 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.914372 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.914663 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.914785 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.914979 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.915094 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.915293 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.915387 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.915607 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.915788 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.915915 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.916094 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.916219 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.916400 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.916530 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.916715 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.916890 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.917061 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.917200 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.917382 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.917507 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.917666 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.917812 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.917975 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.918135 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.918278 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.918439 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.918596 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.918760 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.918911 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.919181 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.919269 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.919497 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.919582 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.919798 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.919889 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.920115 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.920203 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.920432 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.920557 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.920742 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.920874 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.921083 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.921171 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.921448 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.921532 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.921774 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.921884 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.922083 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.922216 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.922395 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.922481 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.922701 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.922861 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.923000 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.923085 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.923298 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.923384 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.923604 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.923699 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.923905 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.924028 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.924203 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.924291 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.924520 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.924614 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.924837 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.924927 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.925146 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.925233 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.925451 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.925574 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.925755 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.925873 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.926053 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.926198 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.926350 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.926510 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.926666 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.926834 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.926964 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.927159 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.927278 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.927465 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.927586 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.928295 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.928428 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.928609 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.928922 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.929014 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.929231 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.929317 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.929552 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.929654 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.929858 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.929943 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.930160 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.930245 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.930461 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.930555 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.930761 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.930847 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.931063 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.931157 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.931368 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.931464 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.931691 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.931824 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.931995 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.932096 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.932322 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.932432 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.932623 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.932730 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.932971 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.933051 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.933290 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.933373 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.933594 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.933745 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.933904 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.934220 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.934517 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.934815 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.934891 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.935120 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.935216 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.935419 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.935506 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.935717 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.935812 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.936014 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.936100 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.936315 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.936401 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.936609 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.936703 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.936928 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.937019 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.937226 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.937361 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.937543 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.937638 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.937840 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.937951 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.938155 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.938288 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.938457 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.938617 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.938755 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.938937 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.939035 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.939256 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.939342 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.939579 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.939667 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.939886 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.939973 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.940190 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.940286 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.940500 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.940586 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.940819 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.940909 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.941130 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.941226 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.941433 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.941526 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.941738 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.941825 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.942040 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.942135 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.942354 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.942452 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.942637 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.942723 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.942955 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.943050 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.943255 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.944020 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.944162 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.944252 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.944473 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.944645 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.944776 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.944989 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.945109 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.945304 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.945404 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.945617 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.945739 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.945931 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.946043 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.946375 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.946470 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.946692 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.946785 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.947013 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.947108 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.947342 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.947442 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.947647 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.947740 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.947962 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.948055 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.948272 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.948360 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.948580 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.948667 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.948916 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.949006 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.949222 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.949309 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.949528 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.949617 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.949840 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.949924 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.950154 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.950242 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.950463 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.950557 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.950777 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.950870 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.951094 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.951182 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.951400 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.951485 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.951711 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.951921 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.952009 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.952253 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.952364 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.952569 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.952665 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.952906 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.952996 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.953222 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.953319 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.953542 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.953637 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.953852 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.953939 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.954164 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.954259 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.954474 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.954570 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.954780 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.954866 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.955092 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.955186 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.955402 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.955496 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.955708 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.955795 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.956015 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.956101 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.956321 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.956415 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.956644 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.956736 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.956989 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.957090 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.957301 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.957394 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.957609 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.957695 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.957915 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.958010 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.958224 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.958311 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.958557 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.958738 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.958874 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.959130 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.959333 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.959415 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.959524 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.959720 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.959841 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.960040 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.960156 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.960350 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.960469 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.960662 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.960800 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.961009 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.961123 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.961313 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.961434 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.961614 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.961746 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.961921 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.962059 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.962226 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.962387 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.962525 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.962726 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.962824 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.963043 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.963129 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.963353 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.963438 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.963664 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.963753 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.963978 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.964063 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.964502 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.964587 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.964847 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.964969 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.965170 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.965277 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.965493 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.965580 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.965815 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.965903 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.966127 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.966211 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.966426 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.966519 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.966746 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.966833 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.967049 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.967135 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.967348 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.967443 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.967659 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.967752 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.967964 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.968049 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.968265 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.968359 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.968566 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.968659 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.968899 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.968987 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.969448 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.969554 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.969757 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.969843 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.970062 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.970147 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.970360 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.970595 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.970687 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.970936 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.971022 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.971249 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.971342 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.971547 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.971635 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.971851 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.971936 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.972148 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.972290 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.972446 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.972533 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.972745 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.972891 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.973065 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.973163 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.973371 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.973459 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.973668 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.973755 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.973982 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.974076 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.974280 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.974365 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.974596 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.974685 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.974904 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.975019 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.975337 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.975470 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.975633 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.975723 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.975944 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.976039 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.976247 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.976333 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.976544 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.976635 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.976875 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.976966 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.977180 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.977265 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.977484 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.977581 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.977788 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.977875 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.978088 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.978173 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.978390 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.978490 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.978696 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.978781 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.978998 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.979235 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.979331 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.979564 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.979651 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.979882 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.979970 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.980199 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.980284 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.980511 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.980598 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.980833 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.980920 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.981136 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.981223 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.981435 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.981522 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.981752 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.981840 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.982055 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.982141 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.982358 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.982443 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.982659 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.982759 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.982967 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.983079 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.983269 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.983364 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.983573 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.983660 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.983877 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.983971 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.984181 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.984279 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.984520 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.984652 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.984983 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.985086 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.985321 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.985416 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.985636 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.985730 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.985950 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.986044 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.986263 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.986349 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.986575 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.986661 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.986879 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.986990 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.987184 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.987271 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.987488 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.987574 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.987807 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.987908 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.988118 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.988211 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.988426 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.988513 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.988737 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.988845 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.989059 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.989152 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.989366 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.989464 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.989676 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.989762 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.989985 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.990071 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.991007 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.991122 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.991324 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.991419 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.991667 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.991777 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.991989 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.992084 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.992307 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.992442 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.992625 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.992712 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.992959 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.993108 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.993252 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.993339 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.993553 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.993640 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.993859 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.993956 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.994183 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.994269 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.994501 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.994587 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.994813 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.994900 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.995131 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.995218 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.995436 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.995528 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.995743 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.995860 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.996047 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.996164 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.996352 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.996485 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.996656 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.996823 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.996984 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.997138 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.997298 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.997469 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.997603 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.997809 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.997916 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.998140 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.998226 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.998464 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.998558 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.998772 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.998860 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.999076 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.999162 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.999372 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.999459 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.999679 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.999771 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:31.999982 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.000069 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.000289 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.000377 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.000621 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.000710 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.000951 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.001051 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.001269 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.001356 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.001573 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.001658 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.001881 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.001994 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.002181 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.002267 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.002487 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.002573 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.002797 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.002896 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.003106 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.003234 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.003408 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.003510 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.003719 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.003833 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.004026 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.004126 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.004334 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.004432 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.004639 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.004751 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.004964 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.005075 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.005271 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.005370 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.005578 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.005679 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.005942 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.006557 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.006742 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.006830 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.007077 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.007172 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.007392 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.007478 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.007714 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.007799 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.008025 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.008112 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.008345 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.008431 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.008654 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.008748 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.009001 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.009087 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.009308 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.009395 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.009618 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.009723 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.009924 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.010010 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.010230 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.010316 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.010544 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.010638 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.010853 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.010939 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.011166 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.011251 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.011476 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.011571 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.011789 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.011874 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.012096 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.012181 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.012407 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.012494 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.012723 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.012835 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.013053 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.013210 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.013378 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.013469 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.013614 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=92560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 07 04:45:32.013700 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.013997 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.014311 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.014619 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.014953 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.015264 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.015578 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.015885 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.016194 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.016509 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.016843 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.017169 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.017492 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.017814 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.018136 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.018480 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.018791 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.019140 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.019466 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:45:32.019710 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=92561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 07 04:45:32.036402 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG oslo_db.sqlalchemy.engines [None req-15466e56-f3a3-464f-a8a2-7cd3d1f71e28 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92560) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 04:45:32.041272 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG oslo_db.sqlalchemy.engines [None req-5cb74feb-3715-4b02-b2be-c4bb66b308d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92561) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 04:45:32.113430 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.context [None req-15466e56-f3a3-464f-a8a2-7cd3d1f71e28 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a0405fdb-5261-4cd0-aff8-05e581b9a634(cell1) {{(pid=92560) load_cells /opt/stack/nova/nova/context.py:464}} Aug 07 04:45:32.118228 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG oslo_concurrency.lockutils [None req-15466e56-f3a3-464f-a8a2-7cd3d1f71e28 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92560) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:45:32.118348 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.context [None req-5cb74feb-3715-4b02-b2be-c4bb66b308d7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a0405fdb-5261-4cd0-aff8-05e581b9a634(cell1) {{(pid=92561) load_cells /opt/stack/nova/nova/context.py:464}} Aug 07 04:45:32.119753 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG oslo_concurrency.lockutils [None req-15466e56-f3a3-464f-a8a2-7cd3d1f71e28 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92560) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:45:32.120557 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG oslo_concurrency.lockutils [None req-15466e56-f3a3-464f-a8a2-7cd3d1f71e28 None None] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92560) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:45:32.122509 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG oslo_concurrency.lockutils [None req-15466e56-f3a3-464f-a8a2-7cd3d1f71e28 None None] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92560) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:45:32.122606 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG oslo_concurrency.lockutils [None req-5cb74feb-3715-4b02-b2be-c4bb66b308d7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:45:32.124083 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG oslo_concurrency.lockutils [None req-5cb74feb-3715-4b02-b2be-c4bb66b308d7 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:45:32.124948 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG oslo_concurrency.lockutils [None req-5cb74feb-3715-4b02-b2be-c4bb66b308d7 None None] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:45:32.126878 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG oslo_concurrency.lockutils [None req-5cb74feb-3715-4b02-b2be-c4bb66b308d7 None None] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:45:32.133908 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG oslo_db.sqlalchemy.engines [None req-15466e56-f3a3-464f-a8a2-7cd3d1f71e28 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92560) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 04:45:32.136537 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG oslo_db.sqlalchemy.engines [None req-15466e56-f3a3-464f-a8a2-7cd3d1f71e28 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92560) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 04:45:32.140501 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG oslo_db.sqlalchemy.engines [None req-5cb74feb-3715-4b02-b2be-c4bb66b308d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92561) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 04:45:32.144768 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG oslo_db.sqlalchemy.engines [None req-5cb74feb-3715-4b02-b2be-c4bb66b308d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92561) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 04:45:32.495202 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG oslo_db.sqlalchemy.engines [None req-15466e56-f3a3-464f-a8a2-7cd3d1f71e28 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92560) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 04:45:32.509325 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG oslo_db.sqlalchemy.engines [None req-5cb74feb-3715-4b02-b2be-c4bb66b308d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92561) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 04:45:32.842756 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: WARNING keystonemiddleware.auth_token [None req-5cb74feb-3715-4b02-b2be-c4bb66b308d7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 07 04:45:32.846458 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: WARNING keystonemiddleware.auth_token [None req-15466e56-f3a3-464f-a8a2-7cd3d1f71e28 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 07 04:45:32.849599 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: WARNING keystonemiddleware.auth_token [None req-5cb74feb-3715-4b02-b2be-c4bb66b308d7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 07 04:45:32.853482 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: WARNING keystonemiddleware.auth_token [None req-15466e56-f3a3-464f-a8a2-7cd3d1f71e28 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 07 04:45:33.198990 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: WARNING keystonemiddleware.auth_token [None req-5cb74feb-3715-4b02-b2be-c4bb66b308d7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 07 04:45:33.204171 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: WARNING keystonemiddleware.auth_token [None req-5cb74feb-3715-4b02-b2be-c4bb66b308d7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 07 04:45:33.208523 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: WARNING keystonemiddleware.auth_token [None req-15466e56-f3a3-464f-a8a2-7cd3d1f71e28 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 07 04:45:33.209952 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b85e33d9c0 pid: 92561 (default app) Aug 07 04:45:33.212046 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi [None req-5cb74feb-3715-4b02-b2be-c4bb66b308d7 None None] Calling method '>' {{(pid=92561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:45:33.213260 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: INFO nova.api.openstack.requestlog [None req-5cb74feb-3715-4b02-b2be-c4bb66b308d7 None None] 10.222.0.35 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001771 Aug 07 04:45:33.213676 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: [pid: 92561|app: 0|req: 1/1] 10.222.0.35 () {50 vars in 789 bytes} [Sat Aug 7 04:45:33 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:45:33.214649 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: WARNING keystonemiddleware.auth_token [None req-15466e56-f3a3-464f-a8a2-7cd3d1f71e28 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 07 04:45:33.220028 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b85e33d9c0 pid: 92560 (default app) Aug 07 04:46:53.045557 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi [None req-5cb74feb-3715-4b02-b2be-c4bb66b308d7 None None] Calling method '>' {{(pid=92561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:46:53.047203 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: INFO nova.api.openstack.requestlog [None req-5cb74feb-3715-4b02-b2be-c4bb66b308d7 None None] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002147 Aug 07 04:46:53.047776 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: [pid: 92561|app: 0|req: 2/2] 10.222.0.35 () {54 vars in 931 bytes} [Sat Aug 7 04:46:53 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:46:53.467069 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi [None req-bc909142-11f8-4fa9-b573-2f801d6680e9 admin admin] Calling method '>' {{(pid=92560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:46:53.497158 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: INFO nova.api.openstack.requestlog [None req-bc909142-11f8-4fa9-b573-2f801d6680e9 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.441498 Aug 07 04:46:53.497958 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: [pid: 92560|app: 0|req: 1/3] 10.222.0.35 () {60 vars in 1292 bytes} [Sat Aug 7 04:46:53 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:46:55.701327 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi [None req-5cb74feb-3715-4b02-b2be-c4bb66b308d7 None None] Calling method '>' {{(pid=92561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:46:55.702336 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: INFO nova.api.openstack.requestlog [None req-5cb74feb-3715-4b02-b2be-c4bb66b308d7 None None] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001547 Aug 07 04:46:55.702746 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: [pid: 92561|app: 0|req: 3/4] 10.222.0.35 () {54 vars in 931 bytes} [Sat Aug 7 04:46:55 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:46:55.769952 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi [None req-fc5bb108-38a7-49e5-ad8a-be8a0da8cdcb admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "swap": 0, "ram": 256, "rxtx_factor": 1.0, "id": "c1", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "cirros256"}} {{(pid=92560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:46:55.789658 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 04:46:55.789658 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: warnings.warn(msg) Aug 07 04:46:55.819631 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: INFO nova.api.openstack.requestlog [None req-fc5bb108-38a7-49e5-ad8a-be8a0da8cdcb admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.109204 Aug 07 04:46:55.820400 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: [pid: 92560|app: 0|req: 2/5] 10.222.0.35 () {64 vars in 1283 bytes} [Sat Aug 7 04:46:55 2021] POST /compute/v2.1/flavors => generated 407 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 04:46:56.038673 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi [None req-78c9a75f-e260-4c49-9381-b432576fba0e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:46:56.041026 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 04:46:56.041026 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: warnings.warn(msg) Aug 07 04:46:56.089395 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: INFO nova.api.openstack.requestlog [None req-78c9a75f-e260-4c49-9381-b432576fba0e admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.260821 Aug 07 04:46:56.090171 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: [pid: 92561|app: 0|req: 4/6] 10.222.0.35 () {64 vars in 1336 bytes} [Sat Aug 7 04:46:55 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:46:58.284471 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi [None req-fc5bb108-38a7-49e5-ad8a-be8a0da8cdcb admin admin] Calling method '>' {{(pid=92560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:46:58.285518 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: INFO nova.api.openstack.requestlog [None req-fc5bb108-38a7-49e5-ad8a-be8a0da8cdcb admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Aug 07 04:46:58.286079 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: [pid: 92560|app: 0|req: 3/7] 10.222.0.35 () {54 vars in 931 bytes} [Sat Aug 7 04:46:58 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:46:58.393235 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi [None req-94b0a5ee-967e-4ecb-a49e-1245ff84892d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "os-flavor-access:is_public": true, "vcpus": 1, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "rxtx_factor": 1.0, "swap": 0, "id": "d1"}} {{(pid=92561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:46:58.411207 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 04:46:58.411207 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: warnings.warn(msg) Aug 07 04:46:58.429927 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: INFO nova.api.openstack.requestlog [None req-94b0a5ee-967e-4ecb-a49e-1245ff84892d admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.137707 Aug 07 04:46:58.430709 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: [pid: 92561|app: 0|req: 5/8] 10.222.0.35 () {64 vars in 1283 bytes} [Sat Aug 7 04:46:58 2021] POST /compute/v2.1/flavors => generated 404 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 04:46:58.444897 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi [None req-5af5011d-82f2-4adb-8633-ea435f614b6a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:46:58.444897 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 04:46:58.444897 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: warnings.warn(msg) Aug 07 04:46:58.476983 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: INFO nova.api.openstack.requestlog [None req-5af5011d-82f2-4adb-8633-ea435f614b6a admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037903 Aug 07 04:46:58.477558 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: [pid: 92560|app: 0|req: 4/9] 10.222.0.35 () {64 vars in 1336 bytes} [Sat Aug 7 04:46:58 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:47:00.665331 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi [None req-94b0a5ee-967e-4ecb-a49e-1245ff84892d admin admin] Calling method '>' {{(pid=92561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:47:00.666930 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: INFO nova.api.openstack.requestlog [None req-94b0a5ee-967e-4ecb-a49e-1245ff84892d admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002131 Aug 07 04:47:00.667325 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: [pid: 92561|app: 0|req: 6/10] 10.222.0.35 () {54 vars in 931 bytes} [Sat Aug 7 04:47:00 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:47:00.727721 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi [None req-ecae816d-8ef8-4e94-9a92-dd6cb914c16b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "ram": 1024, "disk": 10}} {{(pid=92560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:47:00.747069 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: INFO nova.api.openstack.requestlog [None req-ecae816d-8ef8-4e94-9a92-dd6cb914c16b admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073011 Aug 07 04:47:00.747856 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: [pid: 92560|app: 0|req: 5/11] 10.222.0.35 () {64 vars in 1283 bytes} [Sat Aug 7 04:47:00 2021] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 07 04:47:00.760255 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi [None req-a31d3a7a-fd6a-4c4e-9a32-da2be5b20da2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:47:00.785442 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: INFO nova.api.openstack.requestlog [None req-a31d3a7a-fd6a-4c4e-9a32-da2be5b20da2 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028777 Aug 07 04:47:00.786258 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: [pid: 92561|app: 0|req: 7/12] 10.222.0.35 () {64 vars in 1336 bytes} [Sat Aug 7 04:47:00 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:47:02.996847 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi [None req-ecae816d-8ef8-4e94-9a92-dd6cb914c16b admin admin] Calling method '>' {{(pid=92560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:47:02.997842 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: INFO nova.api.openstack.requestlog [None req-ecae816d-8ef8-4e94-9a92-dd6cb914c16b admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Aug 07 04:47:02.998238 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: [pid: 92560|app: 0|req: 6/13] 10.222.0.35 () {54 vars in 931 bytes} [Sat Aug 7 04:47:02 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:47:03.060461 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi [None req-f44232bf-ba4f-40af-83eb-fb5a78c9f050 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 10, "id": "d3", "ram": 2048, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "name": "ds2G"}} {{(pid=92561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:47:03.082170 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: INFO nova.api.openstack.requestlog [None req-f44232bf-ba4f-40af-83eb-fb5a78c9f050 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076717 Aug 07 04:47:03.082774 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: [pid: 92561|app: 0|req: 8/14] 10.222.0.35 () {64 vars in 1283 bytes} [Sat Aug 7 04:47:03 2021] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 04:47:03.095660 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi [None req-520f42ea-9565-4d2b-b8f9-cb5a8095d88b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:47:03.119495 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: INFO nova.api.openstack.requestlog [None req-520f42ea-9565-4d2b-b8f9-cb5a8095d88b admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027659 Aug 07 04:47:03.120241 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: [pid: 92560|app: 0|req: 7/15] 10.222.0.35 () {64 vars in 1336 bytes} [Sat Aug 7 04:47:03 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:47:05.307750 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi [None req-f44232bf-ba4f-40af-83eb-fb5a78c9f050 admin admin] Calling method '>' {{(pid=92561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:47:05.308990 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: INFO nova.api.openstack.requestlog [None req-f44232bf-ba4f-40af-83eb-fb5a78c9f050 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001618 Aug 07 04:47:05.309760 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: [pid: 92561|app: 0|req: 9/16] 10.222.0.35 () {54 vars in 931 bytes} [Sat Aug 7 04:47:05 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:47:05.373720 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi [None req-62584a23-d22b-42e1-b587-c1761b29e954 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "rxtx_factor": 1.0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "os-flavor-access:is_public": true, "swap": 0, "ram": 4096, "id": "d4"}} {{(pid=92560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:47:05.391878 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: INFO nova.api.openstack.requestlog [None req-62584a23-d22b-42e1-b587-c1761b29e954 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075080 Aug 07 04:47:05.393372 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: [pid: 92560|app: 0|req: 8/17] 10.222.0.35 () {64 vars in 1283 bytes} [Sat Aug 7 04:47:05 2021] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 04:47:05.405255 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi [None req-3ddf6039-c522-47d5-b61e-ca59e420ed06 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:47:05.429207 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: INFO nova.api.openstack.requestlog [None req-3ddf6039-c522-47d5-b61e-ca59e420ed06 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027546 Aug 07 04:47:05.429881 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: [pid: 92561|app: 0|req: 10/18] 10.222.0.35 () {64 vars in 1336 bytes} [Sat Aug 7 04:47:05 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:47:07.916005 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi [None req-62584a23-d22b-42e1-b587-c1761b29e954 admin admin] Calling method '>' {{(pid=92560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:47:07.917146 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: INFO nova.api.openstack.requestlog [None req-62584a23-d22b-42e1-b587-c1761b29e954 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Aug 07 04:47:07.917814 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: [pid: 92560|app: 0|req: 9/19] 10.222.0.35 () {54 vars in 931 bytes} [Sat Aug 7 04:47:07 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:47:07.977658 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi [None req-2512a24e-f4c9-4e38-b149-2c3a8643bf37 admin admin] Calling method '>' {{(pid=92561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:47:08.001617 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: INFO nova.api.openstack.requestlog [None req-2512a24e-f4c9-4e38-b149-2c3a8643bf37 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.076912 Aug 07 04:47:08.009214 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: [pid: 92561|app: 0|req: 11/20] 10.222.0.35 () {60 vars in 1292 bytes} [Sat Aug 7 04:47:07 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:47:10.336083 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi [None req-62584a23-d22b-42e1-b587-c1761b29e954 admin admin] Calling method '>' {{(pid=92560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:47:10.337136 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: INFO nova.api.openstack.requestlog [None req-62584a23-d22b-42e1-b587-c1761b29e954 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Aug 07 04:47:10.337541 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: [pid: 92560|app: 0|req: 10/21] 10.222.0.35 () {54 vars in 931 bytes} [Sat Aug 7 04:47:10 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:47:10.435675 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi [None req-f041bf9c-8323-4567-8229-c7a2d84657df admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "rxtx_factor": 1.0, "disk": 1, "os-flavor-access:is_public": true, "ram": 512, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "m1.tiny"}} {{(pid=92561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:47:10.456082 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: INFO nova.api.openstack.requestlog [None req-f041bf9c-8323-4567-8229-c7a2d84657df admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.111169 Aug 07 04:47:10.456564 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: [pid: 92561|app: 0|req: 12/22] 10.222.0.35 () {64 vars in 1283 bytes} [Sat Aug 7 04:47:10 2021] POST /compute/v2.1/flavors => generated 402 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 07 04:47:10.468983 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi [None req-fd2f3381-18d7-4308-9c34-9a3f619bae79 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:47:10.491072 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: INFO nova.api.openstack.requestlog [None req-fd2f3381-18d7-4308-9c34-9a3f619bae79 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026011 Aug 07 04:47:10.491650 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: [pid: 92560|app: 0|req: 11/23] 10.222.0.35 () {64 vars in 1333 bytes} [Sat Aug 7 04:47:10 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:47:12.720536 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi [None req-f041bf9c-8323-4567-8229-c7a2d84657df admin admin] Calling method '>' {{(pid=92561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:47:12.721606 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: INFO nova.api.openstack.requestlog [None req-f041bf9c-8323-4567-8229-c7a2d84657df admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001611 Aug 07 04:47:12.722019 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: [pid: 92561|app: 0|req: 13/24] 10.222.0.35 () {54 vars in 931 bytes} [Sat Aug 7 04:47:12 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:47:12.801846 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi [None req-a4160993-5ca3-4523-8829-5604198447bf admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.small", "vcpus": 1, "swap": 0, "id": "2", "os-flavor-access:is_public": true, "disk": 20, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=92560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:47:12.822074 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: INFO nova.api.openstack.requestlog [None req-a4160993-5ca3-4523-8829-5604198447bf admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.093690 Aug 07 04:47:12.822623 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: [pid: 92560|app: 0|req: 12/25] 10.222.0.35 () {64 vars in 1283 bytes} [Sat Aug 7 04:47:12 2021] POST /compute/v2.1/flavors => generated 405 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 04:47:12.834830 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi [None req-725c5197-f15c-4d07-baf3-c3dd550362c5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:47:12.857764 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: INFO nova.api.openstack.requestlog [None req-725c5197-f15c-4d07-baf3-c3dd550362c5 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026497 Aug 07 04:47:12.858293 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: [pid: 92561|app: 0|req: 14/26] 10.222.0.35 () {64 vars in 1333 bytes} [Sat Aug 7 04:47:12 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:47:15.065730 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi [None req-a4160993-5ca3-4523-8829-5604198447bf admin admin] Calling method '>' {{(pid=92560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:47:15.066819 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: INFO nova.api.openstack.requestlog [None req-a4160993-5ca3-4523-8829-5604198447bf admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Aug 07 04:47:15.067287 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: [pid: 92560|app: 0|req: 13/27] 10.222.0.35 () {54 vars in 931 bytes} [Sat Aug 7 04:47:15 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:47:15.125335 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi [None req-e1fc1ac0-9f18-4efa-ab31-5533cfe50b0d admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "vcpus": 2, "ram": 4096, "os-flavor-access:is_public": true, "id": "3"}} {{(pid=92561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:47:15.143358 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: INFO nova.api.openstack.requestlog [None req-e1fc1ac0-9f18-4efa-ab31-5533cfe50b0d admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.069660 Aug 07 04:47:15.144053 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: [pid: 92561|app: 0|req: 15/28] 10.222.0.35 () {64 vars in 1283 bytes} [Sat Aug 7 04:47:15 2021] POST /compute/v2.1/flavors => generated 406 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 04:47:15.155592 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi [None req-0e27c66f-73c3-4db1-98ab-ae2442b78636 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:47:15.177395 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: INFO nova.api.openstack.requestlog [None req-0e27c66f-73c3-4db1-98ab-ae2442b78636 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025379 Aug 07 04:47:15.177937 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: [pid: 92560|app: 0|req: 14/29] 10.222.0.35 () {64 vars in 1333 bytes} [Sat Aug 7 04:47:15 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:47:17.459699 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi [None req-e1fc1ac0-9f18-4efa-ab31-5533cfe50b0d admin admin] Calling method '>' {{(pid=92561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:47:17.460825 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: INFO nova.api.openstack.requestlog [None req-e1fc1ac0-9f18-4efa-ab31-5533cfe50b0d admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001561 Aug 07 04:47:17.461545 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: [pid: 92561|app: 0|req: 16/30] 10.222.0.35 () {54 vars in 931 bytes} [Sat Aug 7 04:47:17 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:47:17.525760 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi [None req-db7d3691-69e0-48ac-b2f2-60badc2c0d3d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "swap": 0, "rxtx_factor": 1.0, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "os-flavor-access:is_public": true, "name": "m1.large", "vcpus": 4}} {{(pid=92560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:47:17.546548 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: INFO nova.api.openstack.requestlog [None req-db7d3691-69e0-48ac-b2f2-60badc2c0d3d admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.078425 Aug 07 04:47:17.547106 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: [pid: 92560|app: 0|req: 15/31] 10.222.0.35 () {64 vars in 1283 bytes} [Sat Aug 7 04:47:17 2021] POST /compute/v2.1/flavors => generated 405 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 07 04:47:17.559383 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi [None req-f988719a-ac02-453c-b54e-467bc81123e4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:47:17.585615 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: INFO nova.api.openstack.requestlog [None req-f988719a-ac02-453c-b54e-467bc81123e4 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029997 Aug 07 04:47:17.586725 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: [pid: 92561|app: 0|req: 17/32] 10.222.0.35 () {64 vars in 1333 bytes} [Sat Aug 7 04:47:17 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:47:19.827660 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi [None req-db7d3691-69e0-48ac-b2f2-60badc2c0d3d admin admin] Calling method '>' {{(pid=92560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:47:19.829799 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: INFO nova.api.openstack.requestlog [None req-db7d3691-69e0-48ac-b2f2-60badc2c0d3d admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.004412 Aug 07 04:47:19.830393 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: [pid: 92560|app: 0|req: 16/33] 10.222.0.35 () {54 vars in 931 bytes} [Sat Aug 7 04:47:19 2021] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:47:19.893521 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi [None req-9158f5ca-12d8-4cf4-92af-790c460486bf admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "rxtx_factor": 1.0, "disk": 160, "name": "m1.xlarge", "ram": 16384, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=92561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:47:19.914578 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: INFO nova.api.openstack.requestlog [None req-9158f5ca-12d8-4cf4-92af-790c460486bf admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.077244 Aug 07 04:47:19.915432 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: [pid: 92561|app: 0|req: 18/34] 10.222.0.35 () {64 vars in 1283 bytes} [Sat Aug 7 04:47:19 2021] POST /compute/v2.1/flavors => generated 408 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 07 04:47:19.928193 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi [None req-4ec346c6-f13f-42bb-b99d-8695c6f79a88 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:47:19.951999 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: INFO nova.api.openstack.requestlog [None req-4ec346c6-f13f-42bb-b99d-8695c6f79a88 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027367 Aug 07 04:47:19.952771 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: [pid: 92560|app: 0|req: 17/35] 10.222.0.35 () {64 vars in 1333 bytes} [Sat Aug 7 04:47:19 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:47:58.609761 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi [None req-9158f5ca-12d8-4cf4-92af-790c460486bf admin admin] Calling method '>' {{(pid=92561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:47:58.610831 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: INFO nova.api.openstack.requestlog [None req-9158f5ca-12d8-4cf4-92af-790c460486bf admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Aug 07 04:47:58.611231 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: [pid: 92561|app: 0|req: 19/36] 10.222.0.35 () {54 vars in 931 bytes} [Sat Aug 7 04:47:58 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:47:58.669834 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi [None req-c4c31804-1c60-44ec-ab77-3259a50744d8 admin admin] Calling method '>' {{(pid=92560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:47:58.687852 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: INFO nova.api.openstack.requestlog [None req-c4c31804-1c60-44ec-ab77-3259a50744d8 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.070057 Aug 07 04:47:58.688386 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: [pid: 92560|app: 0|req: 18/37] 10.222.0.35 () {60 vars in 1292 bytes} [Sat Aug 7 04:47:58 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:48:00.125026 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi [None req-9158f5ca-12d8-4cf4-92af-790c460486bf admin admin] Calling method '>' {{(pid=92561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:48:00.126019 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: INFO nova.api.openstack.requestlog [None req-9158f5ca-12d8-4cf4-92af-790c460486bf admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Aug 07 04:48:00.126417 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: [pid: 92561|app: 0|req: 20/38] 10.222.0.35 () {56 vars in 1075 bytes} [Sat Aug 7 04:48:00 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:48:00.318318 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi [None req-c792ca23-1f8a-49cb-aabc-896ec78aaf97 admin admin] Calling method '>' {{(pid=92560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:48:00.326478 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: INFO nova.api.openstack.wsgi [None req-c792ca23-1f8a-49cb-aabc-896ec78aaf97 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 07 04:48:00.327556 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi [None req-c792ca23-1f8a-49cb-aabc-896ec78aaf97 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=92560) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 07 04:48:00.328929 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: INFO nova.api.openstack.requestlog [None req-c792ca23-1f8a-49cb-aabc-896ec78aaf97 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.062180 Aug 07 04:48:00.329450 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: [pid: 92560|app: 0|req: 19/39] 10.222.0.35 () {60 vars in 1191 bytes} [Sat Aug 7 04:48:00 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 07 04:48:00.341781 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi [None req-4c26d7df-bc7f-4e29-8df7-d6aaa2d35271 admin admin] Calling method '>' {{(pid=92561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:48:00.365468 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: INFO nova.api.openstack.requestlog [None req-4c26d7df-bc7f-4e29-8df7-d6aaa2d35271 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.028672 Aug 07 04:48:00.366029 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: [pid: 92561|app: 0|req: 21/40] 10.222.0.35 () {60 vars in 1211 bytes} [Sat Aug 7 04:48:00 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:48:00.376409 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi [None req-bf25fc6b-7ecb-4d96-b0a0-8f93494b4b0b admin admin] Calling method '>' {{(pid=92560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:48:00.397443 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: INFO nova.api.openstack.requestlog [None req-bf25fc6b-7ecb-4d96-b0a0-8f93494b4b0b admin admin] 10.222.0.35 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.024751 Aug 07 04:48:00.397961 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: [pid: 92560|app: 0|req: 20/41] 10.222.0.35 () {60 vars in 1211 bytes} [Sat Aug 7 04:48:00 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:48:00.408366 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi [None req-f1ed31f8-fdfd-40d8-8bcd-2c74b451fe38 admin admin] Calling method '>' {{(pid=92561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:48:00.413664 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: INFO nova.api.openstack.wsgi [None req-f1ed31f8-fdfd-40d8-8bcd-2c74b451fe38 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 07 04:48:00.414226 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi [None req-f1ed31f8-fdfd-40d8-8bcd-2c74b451fe38 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=92561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 07 04:48:00.415040 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: INFO nova.api.openstack.requestlog [None req-f1ed31f8-fdfd-40d8-8bcd-2c74b451fe38 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.011024 Aug 07 04:48:00.415525 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: [pid: 92561|app: 0|req: 22/42] 10.222.0.35 () {60 vars in 1191 bytes} [Sat Aug 7 04:48:00 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 07 04:48:01.773091 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi [None req-bf25fc6b-7ecb-4d96-b0a0-8f93494b4b0b admin admin] Calling method '>' {{(pid=92560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:48:01.774096 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: INFO nova.api.openstack.requestlog [None req-bf25fc6b-7ecb-4d96-b0a0-8f93494b4b0b admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Aug 07 04:48:01.774482 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: [pid: 92560|app: 0|req: 21/43] 10.222.0.35 () {56 vars in 1075 bytes} [Sat Aug 7 04:48:01 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:48:01.961980 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi [None req-e96f0933-bac7-4174-9bf1-03533a6a01dc admin admin] Calling method '>' {{(pid=92561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:48:01.968153 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: INFO nova.api.openstack.wsgi [None req-e96f0933-bac7-4174-9bf1-03533a6a01dc admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 07 04:48:01.968727 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi [None req-e96f0933-bac7-4174-9bf1-03533a6a01dc admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=92561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 07 04:48:01.969546 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: INFO nova.api.openstack.requestlog [None req-e96f0933-bac7-4174-9bf1-03533a6a01dc admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.058662 Aug 07 04:48:01.970047 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: [pid: 92561|app: 0|req: 23/44] 10.222.0.35 () {60 vars in 1191 bytes} [Sat Aug 7 04:48:01 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 07 04:48:01.979573 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi [None req-d8dc6ff6-8cae-439d-97d0-e1ca19ccb920 admin admin] Calling method '>' {{(pid=92560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:48:01.993408 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: INFO nova.api.openstack.requestlog [None req-d8dc6ff6-8cae-439d-97d0-e1ca19ccb920 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.017323 Aug 07 04:48:01.993925 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: [pid: 92560|app: 0|req: 22/45] 10.222.0.35 () {60 vars in 1211 bytes} [Sat Aug 7 04:48:01 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:48:02.003643 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi [None req-4c60e255-e35d-437a-a7df-7ffc6ab35338 admin admin] Calling method '>' {{(pid=92561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:48:02.016701 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: INFO nova.api.openstack.requestlog [None req-4c60e255-e35d-437a-a7df-7ffc6ab35338 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.016520 Aug 07 04:48:02.017247 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: [pid: 92561|app: 0|req: 24/46] 10.222.0.35 () {60 vars in 1211 bytes} [Sat Aug 7 04:48:01 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:48:02.026518 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi [None req-c3bc51f4-c86c-443d-b124-02bd2a97806c admin admin] Calling method '>' {{(pid=92560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:48:02.032144 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: INFO nova.api.openstack.wsgi [None req-c3bc51f4-c86c-443d-b124-02bd2a97806c admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 07 04:48:02.032701 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi [None req-c3bc51f4-c86c-443d-b124-02bd2a97806c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=92560) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 07 04:48:02.033503 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: INFO nova.api.openstack.requestlog [None req-c3bc51f4-c86c-443d-b124-02bd2a97806c admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.010386 Aug 07 04:48:02.033983 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: [pid: 92560|app: 0|req: 23/47] 10.222.0.35 () {60 vars in 1191 bytes} [Sat Aug 7 04:48:02 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 07 04:48:03.420632 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi [None req-4c60e255-e35d-437a-a7df-7ffc6ab35338 admin admin] Calling method '>' {{(pid=92561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:48:03.422303 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: INFO nova.api.openstack.requestlog [None req-4c60e255-e35d-437a-a7df-7ffc6ab35338 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002066 Aug 07 04:48:03.422685 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: [pid: 92561|app: 0|req: 25/48] 10.222.0.35 () {56 vars in 1075 bytes} [Sat Aug 7 04:48:03 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:48:03.611788 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi [None req-4a0df389-c424-4bf3-995d-ba36017b7d07 admin admin] Calling method '>' {{(pid=92560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:48:03.618838 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: INFO nova.api.openstack.wsgi [None req-4a0df389-c424-4bf3-995d-ba36017b7d07 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 07 04:48:03.619400 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi [None req-4a0df389-c424-4bf3-995d-ba36017b7d07 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=92560) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 07 04:48:03.620189 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: INFO nova.api.openstack.requestlog [None req-4a0df389-c424-4bf3-995d-ba36017b7d07 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.059897 Aug 07 04:48:03.620694 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: [pid: 92560|app: 0|req: 24/49] 10.222.0.35 () {60 vars in 1194 bytes} [Sat Aug 7 04:48:03 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 07 04:48:03.630643 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi [None req-ef10f912-0175-4394-8155-44ffa03eb2ac admin admin] Calling method '>' {{(pid=92561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:48:03.643925 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: INFO nova.api.openstack.requestlog [None req-ef10f912-0175-4394-8155-44ffa03eb2ac admin admin] 10.222.0.35 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.016848 Aug 07 04:48:03.644490 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: [pid: 92561|app: 0|req: 26/50] 10.222.0.35 () {60 vars in 1211 bytes} [Sat Aug 7 04:48:03 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:48:03.654445 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi [None req-85b371f9-6231-4c81-a780-2944d58d9edc admin admin] Calling method '>' {{(pid=92560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:48:03.668474 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: INFO nova.api.openstack.requestlog [None req-85b371f9-6231-4c81-a780-2944d58d9edc admin admin] 10.222.0.35 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.017485 Aug 07 04:48:03.669032 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: [pid: 92560|app: 0|req: 25/51] 10.222.0.35 () {60 vars in 1211 bytes} [Sat Aug 7 04:48:03 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:48:03.679036 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi [None req-ece66753-a064-432e-a167-4b6941d17e4d admin admin] Calling method '>' {{(pid=92561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:48:03.684086 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: INFO nova.api.openstack.wsgi [None req-ece66753-a064-432e-a167-4b6941d17e4d admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 07 04:48:03.684665 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi [None req-ece66753-a064-432e-a167-4b6941d17e4d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=92561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 07 04:48:03.685469 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: INFO nova.api.openstack.requestlog [None req-ece66753-a064-432e-a167-4b6941d17e4d admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.009905 Aug 07 04:48:03.685955 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: [pid: 92561|app: 0|req: 27/52] 10.222.0.35 () {60 vars in 1194 bytes} [Sat Aug 7 04:48:03 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 07 04:48:05.043589 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi [None req-85b371f9-6231-4c81-a780-2944d58d9edc admin admin] Calling method '>' {{(pid=92560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:48:05.044583 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: INFO nova.api.openstack.requestlog [None req-85b371f9-6231-4c81-a780-2944d58d9edc admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Aug 07 04:48:05.045011 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: [pid: 92560|app: 0|req: 26/53] 10.222.0.35 () {56 vars in 1075 bytes} [Sat Aug 7 04:48:05 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:48:05.237296 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi [None req-f690cb33-a6cb-412c-8938-6b32be13c76b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=92561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:48:05.257873 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: INFO nova.api.openstack.requestlog [None req-f690cb33-a6cb-412c-8938-6b32be13c76b admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.88 time: 0.073329 Aug 07 04:48:05.258339 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: [pid: 92561|app: 0|req: 28/54] 10.222.0.35 () {64 vars in 1236 bytes} [Sat Aug 7 04:48:05 2021] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 04:48:06.603035 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi [None req-85b371f9-6231-4c81-a780-2944d58d9edc admin admin] Calling method '>' {{(pid=92560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:48:06.604075 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: INFO nova.api.openstack.requestlog [None req-85b371f9-6231-4c81-a780-2944d58d9edc admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Aug 07 04:48:06.604454 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: [pid: 92560|app: 0|req: 27/55] 10.222.0.35 () {56 vars in 1075 bytes} [Sat Aug 7 04:48:06 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:48:06.798161 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi [None req-a71523f4-ec26-433d-85f1-8b8c8f022fae admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=92561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:48:06.815622 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: INFO nova.api.openstack.requestlog [None req-a71523f4-ec26-433d-85f1-8b8c8f022fae admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.88 time: 0.069842 Aug 07 04:48:06.816090 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: [pid: 92561|app: 0|req: 29/56] 10.222.0.35 () {64 vars in 1236 bytes} [Sat Aug 7 04:48:06 2021] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 04:48:08.172159 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi [None req-85b371f9-6231-4c81-a780-2944d58d9edc admin admin] Calling method '>' {{(pid=92560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:48:08.173191 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: INFO nova.api.openstack.requestlog [None req-85b371f9-6231-4c81-a780-2944d58d9edc admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Aug 07 04:48:08.173576 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: [pid: 92560|app: 0|req: 28/57] 10.222.0.35 () {56 vars in 1075 bytes} [Sat Aug 7 04:48:08 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:48:08.364521 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi [None req-6991e08b-0043-42ec-8603-9b97b34d1cad admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=92561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:48:08.383574 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: INFO nova.api.openstack.requestlog [None req-6991e08b-0043-42ec-8603-9b97b34d1cad admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.88 time: 0.069998 Aug 07 04:48:08.384040 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: [pid: 92561|app: 0|req: 30/58] 10.222.0.35 () {64 vars in 1236 bytes} [Sat Aug 7 04:48:08 2021] POST /compute/v2.1/flavors => generated 407 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 04:48:09.729921 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi [None req-85b371f9-6231-4c81-a780-2944d58d9edc admin admin] Calling method '>' {{(pid=92560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:48:09.730939 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: INFO nova.api.openstack.requestlog [None req-85b371f9-6231-4c81-a780-2944d58d9edc admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Aug 07 04:48:09.731341 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: [pid: 92560|app: 0|req: 29/59] 10.222.0.35 () {56 vars in 1075 bytes} [Sat Aug 7 04:48:09 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:48:09.919016 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi [None req-e9da478f-10d8-445a-be5c-0083312a8ec7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=92561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:48:09.937378 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: INFO nova.api.openstack.requestlog [None req-e9da478f-10d8-445a-be5c-0083312a8ec7 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.88 time: 0.068054 Aug 07 04:48:09.938004 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: [pid: 92561|app: 0|req: 31/60] 10.222.0.35 () {64 vars in 1236 bytes} [Sat Aug 7 04:48:09 2021] POST /compute/v2.1/flavors => generated 409 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 04:48:11.345514 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi [None req-85b371f9-6231-4c81-a780-2944d58d9edc admin admin] Calling method '>' {{(pid=92560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:48:11.346503 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: INFO nova.api.openstack.requestlog [None req-85b371f9-6231-4c81-a780-2944d58d9edc admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Aug 07 04:48:11.346893 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: [pid: 92560|app: 0|req: 30/61] 10.222.0.35 () {56 vars in 1075 bytes} [Sat Aug 7 04:48:11 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:48:11.539645 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi [None req-8bc0931d-75e7-4a05-9ef1-0cecc14d37ab admin admin] Calling method '>' {{(pid=92561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:48:11.558515 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: INFO nova.api.openstack.requestlog [None req-8bc0931d-75e7-4a05-9ef1-0cecc14d37ab admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.070077 Aug 07 04:48:11.558971 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: [pid: 92561|app: 0|req: 32/62] 10.222.0.35 () {60 vars in 1203 bytes} [Sat Aug 7 04:48:11 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:48:58.061045 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi [None req-85b371f9-6231-4c81-a780-2944d58d9edc admin admin] Calling method '>' {{(pid=92560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:48:58.062048 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: INFO nova.api.openstack.requestlog [None req-85b371f9-6231-4c81-a780-2944d58d9edc admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Aug 07 04:48:58.062436 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: [pid: 92560|app: 0|req: 31/63] 10.222.0.35 () {54 vars in 931 bytes} [Sat Aug 7 04:48:58 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:48:58.119598 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi [None req-864fdd57-754a-455f-8dcb-058c8a9cffa2 admin admin] Calling method '>' {{(pid=92561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:48:58.138834 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: INFO nova.api.openstack.requestlog [None req-864fdd57-754a-455f-8dcb-058c8a9cffa2 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.069915 Aug 07 04:48:58.139352 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: [pid: 92561|app: 0|req: 33/64] 10.222.0.35 () {60 vars in 1292 bytes} [Sat Aug 7 04:48:58 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:48:58.161516 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi [None req-5332ea4a-a294-42b8-8b73-c673cc64e22f admin admin] Calling method '>' {{(pid=92560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:48:58.169629 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: INFO nova.api.openstack.requestlog [None req-5332ea4a-a294-42b8-8b73-c673cc64e22f admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011654 Aug 07 04:48:58.170131 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: [pid: 92560|app: 0|req: 32/65] 10.222.0.35 () {60 vars in 1283 bytes} [Sat Aug 7 04:48:58 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:48:58.181504 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi [None req-e6756c16-cd33-48e8-87d9-163453290595 admin admin] Calling method '>' {{(pid=92561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:48:58.189018 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: INFO nova.api.openstack.requestlog [None req-e6756c16-cd33-48e8-87d9-163453290595 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010952 Aug 07 04:48:58.189523 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: [pid: 92561|app: 0|req: 34/66] 10.222.0.35 () {60 vars in 1286 bytes} [Sat Aug 7 04:48:58 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:48:58.200399 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi [None req-4ad5ab1f-53e7-4780-be1c-fb3e27a92544 admin admin] Calling method '>' {{(pid=92560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:48:58.207884 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: INFO nova.api.openstack.requestlog [None req-4ad5ab1f-53e7-4780-be1c-fb3e27a92544 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010811 Aug 07 04:48:58.208391 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: [pid: 92560|app: 0|req: 33/67] 10.222.0.35 () {60 vars in 1286 bytes} [Sat Aug 7 04:48:58 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:48:58.220189 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi [None req-95de94c2-5d7e-4d82-9ebf-ea756deee53b admin admin] Calling method '>' {{(pid=92561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:48:58.227480 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: INFO nova.api.openstack.requestlog [None req-95de94c2-5d7e-4d82-9ebf-ea756deee53b admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010630 Aug 07 04:48:58.227983 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: [pid: 92561|app: 0|req: 35/68] 10.222.0.35 () {60 vars in 1283 bytes} [Sat Aug 7 04:48:58 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:50:21.967299 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi [None req-f8bb49a9-871f-4178-bcae-8007330aca63 tempest-verify_tempest_config-54586896 tempest-verify_tempest_config-54586896-project] Calling method '>' {{(pid=92560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:50:21.969310 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: INFO nova.api.openstack.requestlog [None req-f8bb49a9-871f-4178-bcae-8007330aca63 tempest-verify_tempest_config-54586896 tempest-verify_tempest_config-54586896-project] 10.222.0.35 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.105816 Aug 07 04:50:21.969833 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: [pid: 92560|app: 0|req: 34/69] 10.222.0.35 () {58 vars in 1134 bytes} [Sat Aug 7 04:50:21 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 04:51:47.038993 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi [None req-95de94c2-5d7e-4d82-9ebf-ea756deee53b admin admin] Calling method '>' {{(pid=92561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:51:47.039992 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: INFO nova.api.openstack.requestlog [None req-95de94c2-5d7e-4d82-9ebf-ea756deee53b admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Aug 07 04:51:47.040425 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: [pid: 92561|app: 0|req: 36/70] 10.222.0.35 () {56 vars in 1075 bytes} [Sat Aug 7 04:51:47 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:51:47.291822 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi [None req-b929979a-61ce-4b96-a7f0-5b42d82b7b14 admin admin] Calling method '>' {{(pid=92560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:51:47.293000 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 04:51:47.293000 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: warnings.warn(msg) Aug 07 04:51:47.295339 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG oslo_concurrency.lockutils [None req-b929979a-61ce-4b96-a7f0-5b42d82b7b14 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92560) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:51:47.295788 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG oslo_concurrency.lockutils [None req-b929979a-61ce-4b96-a7f0-5b42d82b7b14 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92560) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:51:47.296577 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG oslo_concurrency.lockutils [None req-b929979a-61ce-4b96-a7f0-5b42d82b7b14 admin admin] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92560) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:51:47.297049 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG oslo_concurrency.lockutils [None req-b929979a-61ce-4b96-a7f0-5b42d82b7b14 admin admin] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92560) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:51:47.330199 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: INFO nova.api.openstack.requestlog [None req-b929979a-61ce-4b96-a7f0-5b42d82b7b14 admin admin] 10.222.0.35 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.151280 Aug 07 04:51:47.330744 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: [pid: 92560|app: 0|req: 35/71] 10.222.0.35 () {60 vars in 1194 bytes} [Sat Aug 7 04:51:47 2021] GET /compute/v2.1/os-services => generated 791 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 04:51:48.680411 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi [None req-95de94c2-5d7e-4d82-9ebf-ea756deee53b admin admin] Calling method '>' {{(pid=92561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:51:48.681460 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: INFO nova.api.openstack.requestlog [None req-95de94c2-5d7e-4d82-9ebf-ea756deee53b admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Aug 07 04:51:48.681856 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: [pid: 92561|app: 0|req: 37/72] 10.222.0.35 () {56 vars in 1075 bytes} [Sat Aug 7 04:51:48 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:51:48.872092 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi [None req-2ac827d3-798c-4b99-b61a-89f0e3e08e5a admin admin] Calling method '>' {{(pid=92560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:51:48.873256 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 04:51:48.873256 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: warnings.warn(msg) Aug 07 04:51:48.874778 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG oslo_concurrency.lockutils [None req-2ac827d3-798c-4b99-b61a-89f0e3e08e5a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92560) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:51:48.875210 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG oslo_concurrency.lockutils [None req-2ac827d3-798c-4b99-b61a-89f0e3e08e5a admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92560) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:51:48.875980 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG oslo_concurrency.lockutils [None req-2ac827d3-798c-4b99-b61a-89f0e3e08e5a admin admin] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92560) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:51:48.876398 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG oslo_concurrency.lockutils [None req-2ac827d3-798c-4b99-b61a-89f0e3e08e5a admin admin] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92560) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:51:48.895475 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: INFO nova.api.openstack.requestlog [None req-2ac827d3-798c-4b99-b61a-89f0e3e08e5a admin admin] 10.222.0.35 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.074527 Aug 07 04:51:48.895956 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: [pid: 92560|app: 0|req: 36/73] 10.222.0.35 () {60 vars in 1194 bytes} [Sat Aug 7 04:51:48 2021] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 04:52:00.708025 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi [None req-95de94c2-5d7e-4d82-9ebf-ea756deee53b admin admin] Calling method '>' {{(pid=92561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:52:00.709075 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: INFO nova.api.openstack.requestlog [None req-95de94c2-5d7e-4d82-9ebf-ea756deee53b admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Aug 07 04:52:00.709492 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: [pid: 92561|app: 0|req: 38/74] 10.222.0.35 () {56 vars in 1075 bytes} [Sat Aug 7 04:52:00 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:52:00.910558 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi [None req-d72e38fc-352b-4f53-b410-dc4a1618e30b admin admin] Calling method '>' {{(pid=92560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:52:00.911703 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 04:52:00.911703 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: warnings.warn(msg) Aug 07 04:52:00.913255 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG oslo_concurrency.lockutils [None req-d72e38fc-352b-4f53-b410-dc4a1618e30b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92560) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:52:00.913688 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG oslo_concurrency.lockutils [None req-d72e38fc-352b-4f53-b410-dc4a1618e30b admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92560) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:52:00.914467 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG oslo_concurrency.lockutils [None req-d72e38fc-352b-4f53-b410-dc4a1618e30b admin admin] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92560) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:52:00.914888 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG oslo_concurrency.lockutils [None req-d72e38fc-352b-4f53-b410-dc4a1618e30b admin admin] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92560) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:52:00.939461 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: INFO nova.api.openstack.requestlog [None req-d72e38fc-352b-4f53-b410-dc4a1618e30b admin admin] 10.222.0.35 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.085203 Aug 07 04:52:00.939939 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: [pid: 92560|app: 0|req: 37/75] 10.222.0.35 () {60 vars in 1194 bytes} [Sat Aug 7 04:52:00 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:52:02.317638 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: DEBUG nova.api.openstack.wsgi [None req-95de94c2-5d7e-4d82-9ebf-ea756deee53b admin admin] Calling method '>' {{(pid=92561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:52:02.318618 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: INFO nova.api.openstack.requestlog [None req-95de94c2-5d7e-4d82-9ebf-ea756deee53b admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Aug 07 04:52:02.319005 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: [pid: 92561|app: 0|req: 39/76] 10.222.0.35 () {56 vars in 1075 bytes} [Sat Aug 7 04:52:02 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:52:02.522687 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG nova.api.openstack.wsgi [None req-a80f97e9-d676-44fe-a4e5-c8be967cbdd1 admin admin] Calling method '>' {{(pid=92560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:52:02.523824 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 04:52:02.523824 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: warnings.warn(msg) Aug 07 04:52:02.525471 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG oslo_concurrency.lockutils [None req-a80f97e9-d676-44fe-a4e5-c8be967cbdd1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92560) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:52:02.525955 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG oslo_concurrency.lockutils [None req-a80f97e9-d676-44fe-a4e5-c8be967cbdd1 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92560) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:52:02.526709 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG oslo_concurrency.lockutils [None req-a80f97e9-d676-44fe-a4e5-c8be967cbdd1 admin admin] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92560) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:52:02.527127 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: DEBUG oslo_concurrency.lockutils [None req-a80f97e9-d676-44fe-a4e5-c8be967cbdd1 admin admin] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92560) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:52:02.548004 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: INFO nova.api.openstack.requestlog [None req-a80f97e9-d676-44fe-a4e5-c8be967cbdd1 admin admin] 10.222.0.35 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.88 time: 0.078273 Aug 07 04:52:02.549011 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: [pid: 92560|app: 0|req: 38/77] 10.222.0.35 () {60 vars in 1194 bytes} [Sat Aug 7 04:52:02 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:52:57.910382 dv-cinder-803748-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 07 04:52:57.911396 dv-cinder-803748-3-iscsi devstack@n-api.service[92559]: Sat Aug 7 04:52:57 2021 - graceful shutdown triggered... Aug 07 04:52:57.911843 dv-cinder-803748-3-iscsi devstack@n-api.service[92560]: Gracefully killing worker 1 (pid: 92560)... Aug 07 04:52:57.912274 dv-cinder-803748-3-iscsi devstack@n-api.service[92561]: Gracefully killing worker 2 (pid: 92561)... Aug 07 04:52:58.911590 dv-cinder-803748-3-iscsi devstack@n-api.service[92559]: worker 1 buried after 1 seconds Aug 07 04:52:58.912080 dv-cinder-803748-3-iscsi devstack@n-api.service[92559]: worker 2 buried after 1 seconds Aug 07 04:52:58.912080 dv-cinder-803748-3-iscsi devstack@n-api.service[92559]: goodbye to uWSGI. Aug 07 04:52:58.913208 dv-cinder-803748-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 07 04:52:58.913773 dv-cinder-803748-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 07 04:52:58.916639 dv-cinder-803748-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 07 04:52:58.928158 dv-cinder-803748-3-iscsi devstack@n-api.service[107466]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 07 04:52:58.930178 dv-cinder-803748-3-iscsi devstack@n-api.service[107466]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Aug 7 04:52:58 2021] *** Aug 07 04:52:58.930178 dv-cinder-803748-3-iscsi devstack@n-api.service[107466]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 07 04:52:58.930178 dv-cinder-803748-3-iscsi devstack@n-api.service[107466]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 07 04:52:58.930178 dv-cinder-803748-3-iscsi devstack@n-api.service[107466]: nodename: dv-cinder-803748-3-iscsi Aug 07 04:52:58.930178 dv-cinder-803748-3-iscsi devstack@n-api.service[107466]: machine: x86_64 Aug 07 04:52:58.930178 dv-cinder-803748-3-iscsi devstack@n-api.service[107466]: clock source: unix Aug 07 04:52:58.930178 dv-cinder-803748-3-iscsi devstack@n-api.service[107466]: pcre jit disabled Aug 07 04:52:58.930178 dv-cinder-803748-3-iscsi devstack@n-api.service[107466]: detected number of CPU cores: 4 Aug 07 04:52:58.930178 dv-cinder-803748-3-iscsi devstack@n-api.service[107466]: current working directory: / Aug 07 04:52:58.930178 dv-cinder-803748-3-iscsi devstack@n-api.service[107466]: detected binary path: /usr/bin/uwsgi-core Aug 07 04:52:58.930825 dv-cinder-803748-3-iscsi devstack@n-api.service[107466]: your processes number limit is 47680 Aug 07 04:52:58.930825 dv-cinder-803748-3-iscsi devstack@n-api.service[107466]: your memory page size is 4096 bytes Aug 07 04:52:58.930825 dv-cinder-803748-3-iscsi devstack@n-api.service[107466]: detected max file descriptor number: 2048 Aug 07 04:52:58.930825 dv-cinder-803748-3-iscsi devstack@n-api.service[107466]: lock engine: pthread robust mutexes Aug 07 04:52:58.930825 dv-cinder-803748-3-iscsi devstack@n-api.service[107466]: thunder lock: enabled Aug 07 04:52:58.930825 dv-cinder-803748-3-iscsi devstack@n-api.service[107466]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 07 04:52:58.930825 dv-cinder-803748-3-iscsi devstack@n-api.service[107466]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Aug 07 04:52:58.982408 dv-cinder-803748-3-iscsi devstack@n-api.service[107466]: Python main interpreter initialized at 0x55e8bb60f9c0 Aug 07 04:52:58.982408 dv-cinder-803748-3-iscsi devstack@n-api.service[107466]: python threads support enabled Aug 07 04:52:58.982408 dv-cinder-803748-3-iscsi devstack@n-api.service[107466]: your server socket listen backlog is limited to 100 connections Aug 07 04:52:58.982408 dv-cinder-803748-3-iscsi devstack@n-api.service[107466]: your mercy for graceful operations on workers is 90 seconds Aug 07 04:52:58.982408 dv-cinder-803748-3-iscsi devstack@n-api.service[107466]: mapped 403077 bytes (393 KB) for 2 cores Aug 07 04:52:58.982408 dv-cinder-803748-3-iscsi devstack@n-api.service[107466]: *** Operational MODE: preforking *** Aug 07 04:52:58.982408 dv-cinder-803748-3-iscsi devstack@n-api.service[107466]: *** uWSGI is running in multiple interpreter mode *** Aug 07 04:52:58.982408 dv-cinder-803748-3-iscsi devstack@n-api.service[107466]: spawned uWSGI master process (pid: 107466) Aug 07 04:52:58.982408 dv-cinder-803748-3-iscsi devstack@n-api.service[107466]: spawned uWSGI worker 1 (pid: 107485, cores: 1) Aug 07 04:52:58.986699 dv-cinder-803748-3-iscsi devstack@n-api.service[107466]: spawned uWSGI worker 2 (pid: 107486, cores: 1) Aug 07 04:52:58.986699 dv-cinder-803748-3-iscsi devstack@n-api.service[107466]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 07 04:52:58.982939 dv-cinder-803748-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 07 04:53:00.807599 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 04:53:00.807599 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: from cryptography.utils import int_from_bytes Aug 07 04:53:00.809098 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 04:53:00.809098 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: from cryptography.utils import int_from_bytes Aug 07 04:53:00.813122 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 04:53:00.813122 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: from cryptography.utils import int_from_bytes Aug 07 04:53:00.813673 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 04:53:00.813673 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: from cryptography.utils import int_from_bytes Aug 07 04:53:03.352682 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 07 04:53:03.353364 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 07 04:53:03.353472 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 07 04:53:03.353780 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 07 04:53:03.354042 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 07 04:53:03.354432 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.354761 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.355231 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.355550 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.355890 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.356208 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.356542 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.356892 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.357227 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.357495 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.357818 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.358148 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-803748-3-iscsi {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.358476 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.358789 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.359105 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.359432 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.359743 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.360083 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.360386 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.360912 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.362174 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.362174 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.362174 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.362443 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.362592 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.362905 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.363233 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.363548 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.363879 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.364193 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.364597 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-803748-3-iscsi {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.364943 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.365264 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.365585 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.366002 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.366318 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.366638 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.366964 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.367290 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.367604 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.367938 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.368264 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.368593 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.368941 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.369261 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.369577 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.369894 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.370221 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.371055 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.371371 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.371630 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.371945 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.372270 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.372597 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.372950 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.373212 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.373470 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.373795 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.374123 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.374437 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.374750 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.375063 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.375377 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.375690 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.376004 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.376317 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.376628 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.376978 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.377298 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.377625 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.377940 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.378264 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.378667 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.35 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.378923 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.35 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.379238 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.379586 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.379943 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.380219 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.380572 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.380891 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.381208 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.381521 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.381900 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.382162 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.382491 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.382801 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.383058 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.383363 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.383677 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.384001 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.384315 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.384631 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.384973 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.385282 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.385597 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.385912 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.386804 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.387124 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.387617 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.387932 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.388248 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.388561 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.388903 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.389230 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.389558 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.389878 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.390192 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.390506 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.390822 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.391152 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.391469 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.391785 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.392114 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.392427 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.392738 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.393088 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.393405 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.393721 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.394048 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.394355 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.394669 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.394993 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.395305 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.395618 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.395928 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.396238 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.396548 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.396887 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.397200 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.397510 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.397815 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.398141 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.398471 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.398785 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.399100 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.399411 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.399740 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.400082 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.400422 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.400867 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.401119 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.401460 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.401827 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.402222 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.402540 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.402863 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.403199 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.403518 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.403837 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.404155 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.404482 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.404828 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.405170 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.405497 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.405818 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.406143 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.406459 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.406784 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.407117 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.407445 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.407760 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.408107 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.408453 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.408798 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.409126 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.409442 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.409775 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.410096 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.410416 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.410737 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.411061 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.411379 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.411701 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.412045 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.412368 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.412690 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.413028 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.413340 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.413651 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.413967 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.414278 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.414604 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.414938 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.415253 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.415592 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.415907 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.416226 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.416544 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.416881 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.417204 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.417650 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.417968 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.418299 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.418617 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.418929 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.419261 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.419570 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.419886 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.420204 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.420520 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.420931 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.421258 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.421586 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.421905 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.422223 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.422565 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.422903 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.423214 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.423544 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.423876 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.424097 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 07 04:53:03.424536 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.424685 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 07 04:53:03.424858 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.424858 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.425133 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 07 04:53:03.425265 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.425410 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 07 04:53:03.425552 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.425692 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 07 04:53:03.425831 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.425970 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.426101 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.426246 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.426387 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.426521 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.426650 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.426788 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.426926 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.427071 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.427211 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.427371 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.427521 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.427720 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.427866 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.427998 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.428134 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.428317 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.428450 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.428581 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.428720 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.428915 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.429065 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.429231 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-803748-3-iscsi {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.429433 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.429576 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.429728 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.429862 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.430002 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.430141 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.430272 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.430452 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.430600 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.430758 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.430900 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.431081 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.431244 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.431454 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.431597 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.431795 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.431937 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.432115 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.432241 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.432445 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.432582 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.432757 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.432918 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.433609 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.433924 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.434132 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.434279 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.434420 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.434559 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.434692 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.434879 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.435018 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.435197 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.435334 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.435517 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.435653 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.435843 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.435989 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.436159 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.436303 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-803748-3-iscsi {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.436478 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.436623 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.436824 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.436980 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.437121 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.437260 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.437424 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.437647 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.437872 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.438010 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.438148 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.438288 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.438428 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.438570 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.438708 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.438884 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.439028 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.439198 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.439347 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.439571 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.439717 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.439849 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.439980 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.440142 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.440307 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.440465 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.440610 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.440773 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.440947 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.441117 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.441254 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.441500 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.441710 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.441871 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.442011 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.442143 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.442274 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.442417 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.442557 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.442690 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.442828 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.442968 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.443112 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.443250 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.443381 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.443512 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.443650 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.443811 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.443963 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.444104 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.444242 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.444376 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.444507 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.444646 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.444778 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.444951 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.445094 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.445251 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.445423 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.445575 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.445741 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.445877 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.446062 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.446206 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.446379 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.446543 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.446696 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.446831 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.447024 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.447167 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.447338 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.447488 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.447653 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.447788 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.447997 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.448136 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.448283 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.448413 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.448574 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.449310 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.449678 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.449949 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.450156 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.450368 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.35 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.450511 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.450645 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.35 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.450786 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.450948 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.451093 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.451298 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.451448 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.451625 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.451848 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.451992 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.452156 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.452311 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.452567 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.452703 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.452908 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.453055 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.453224 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.453359 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.453539 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.453673 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.453864 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.454008 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.454193 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.454335 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.454503 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.454646 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.454779 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.454919 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.455051 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.455190 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.455349 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.455483 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.455672 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.455816 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.455984 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.456127 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.456295 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.456428 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.456608 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.456743 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.456928 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.457069 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.457238 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.457380 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.457550 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.457685 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.457860 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.458010 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.458188 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.458329 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.458475 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.458616 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.458748 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.458878 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.459058 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.459193 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.459365 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.459503 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.459657 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.459866 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.460002 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.460136 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.460280 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.460420 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.460581 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.460722 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.460919 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.461233 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.461546 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.461880 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.462200 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.462512 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.462867 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.463181 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.463532 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.463846 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.463966 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.464159 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.464322 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.464622 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.464963 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.465102 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.465277 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.465432 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.465589 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.465734 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.465906 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.466049 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.466475 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.466636 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.466770 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.467401 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.467569 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.467720 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.467853 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.467992 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.468138 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.468270 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.468395 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.468530 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.468668 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.468813 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.468943 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.469257 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.469609 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.469758 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.470016 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.470153 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.470300 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.470300 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.470538 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.470656 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.470778 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.471037 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.471183 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.471316 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.471477 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.471610 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.471725 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.471855 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.472151 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.472298 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.472430 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.472568 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.472684 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.472836 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.473050 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.473313 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.473451 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.473592 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.473769 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.473919 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.474053 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.474193 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.474193 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.474452 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.474583 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.474724 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.474863 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.475003 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 04:53:03.475135 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.475274 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.475420 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.475561 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.475700 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.475833 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.475953 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.476098 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.476243 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.476377 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.476515 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.476644 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.476782 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.476947 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.477093 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.477227 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.477365 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.477497 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.477627 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.477816 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.477961 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.478135 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.478271 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.478446 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.478588 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.478756 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.478893 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.479067 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.479203 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.479379 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.479515 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.479690 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.479827 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.480296 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.480448 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.480726 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.480989 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.481137 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.481375 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.481496 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.481691 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.481823 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.482021 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.482277 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.482432 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.482582 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.482730 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.482879 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.483141 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.483299 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.483447 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.483606 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.483766 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.483928 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.484100 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.484261 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.484411 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.484561 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.484712 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.484911 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.485078 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.485240 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.485399 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.485562 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.485711 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.485843 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.485963 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.486102 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.486242 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.486382 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.486514 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.486659 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.486792 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.486933 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.487071 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.487193 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.487334 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.487477 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.487616 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.487797 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.487931 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.488108 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.488243 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.488419 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.488556 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.488729 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.488915 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.489073 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.489217 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.489383 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.489520 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.489709 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.489859 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.490040 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.490200 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.490416 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.490554 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.490687 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.490816 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.490969 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.491119 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.491281 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.491416 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.491598 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.491741 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.491906 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.492056 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.492217 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.492432 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.492576 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.492707 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.492860 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.493011 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.493219 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.493427 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.493564 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.493697 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.493844 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.494014 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.494218 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.494375 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.494509 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.494642 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.494789 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.494929 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.495063 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.495193 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.495331 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.495463 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.496190 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.496360 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.496587 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.496992 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.497146 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.497335 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.497480 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.497654 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.497790 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.497976 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.498123 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.498347 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.498482 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.498621 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.498753 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.498885 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.499017 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.499260 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.499396 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.499594 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.499729 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.499916 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.500051 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.500226 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.500394 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.500602 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.500736 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.500888 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.501022 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.501168 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.501310 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.501449 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.501580 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.501766 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.501917 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.502074 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.502217 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.502382 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.502598 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.502741 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.502888 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.503023 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.503154 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.503295 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.503442 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.503647 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.503797 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.503931 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.504062 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.504202 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.504335 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.504477 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.504739 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.504917 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.505084 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.505229 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.505401 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.505554 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.505731 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.505877 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.506050 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.506192 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.506378 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.506602 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.506737 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.506875 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.507015 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.507154 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.507293 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.507436 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.508163 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.508311 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.508444 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.508574 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.508714 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.508892 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.509029 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.509168 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.509300 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.509439 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.509582 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.509715 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.509847 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.509977 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.510109 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.510247 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.510395 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.510536 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.510763 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.510898 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.511038 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.511211 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.511868 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.512012 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.512153 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.512285 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.512517 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.512746 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.512903 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.513038 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.513168 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.513362 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.513508 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.513669 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.513869 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.514006 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.514137 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.514304 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.514448 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.514622 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.514761 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.514942 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.515078 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.515255 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.515391 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.515576 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.515726 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.515869 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.516012 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.516191 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.516374 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.516509 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.516640 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.516772 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.516997 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.517128 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.517273 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.517449 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.517594 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.517781 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.517918 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.518111 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.518258 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.518420 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.518562 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.518728 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.518874 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.519050 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.519194 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.519361 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.519497 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.519667 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.519810 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.519962 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.520096 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.520271 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.520404 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.520608 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.520764 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.521001 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.521145 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.521289 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.521422 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.521553 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.521683 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.521853 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.521991 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.522168 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.522303 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.522485 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.522630 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.522788 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.522989 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.523133 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.523265 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.523404 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.523550 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.523712 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.523864 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.524069 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.524205 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.524337 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.524486 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.524628 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.524776 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.524993 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.525126 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.525257 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.525407 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.525553 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.525693 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.525931 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.526098 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.526225 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.526354 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.526470 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.526582 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.526826 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.526975 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.527244 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.527591 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.527738 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.527915 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.528053 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.528230 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.528547 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.528691 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.528884 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.529036 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.529237 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.529381 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.529551 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.529696 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.529893 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.530035 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.530217 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.530365 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.530545 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.530687 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.530878 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.531024 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.531238 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.531389 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.531530 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.531651 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.531799 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.531943 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.532109 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.532253 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.532419 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.532554 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.532736 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.532899 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.533124 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.533265 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.533388 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.533502 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.533670 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.533806 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.533985 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.534210 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.534348 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.534487 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.534619 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.534749 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.534879 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.535018 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.535181 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.535499 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.535640 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.535809 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.535946 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.536128 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.536263 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.536435 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.536581 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.536764 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.536976 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.537119 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.537262 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.537401 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.537533 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.537671 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.537812 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.537970 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.538106 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.538315 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.538460 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.538625 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.538769 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.538957 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.539092 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.539288 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.539422 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.539624 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.539768 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.539930 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.540072 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.540239 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.540374 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.540568 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.540715 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.540903 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.541039 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.541285 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.541440 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.541582 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.541714 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.541849 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.541988 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.542129 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.542276 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.542466 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.542625 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.542817 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.543158 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.543303 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.543446 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.543590 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.543757 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.543903 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.544085 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.544244 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.544443 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.544586 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.544726 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.544904 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.545041 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.545161 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.545350 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.545488 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.545657 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.545803 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.545967 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.546111 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.546281 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.546416 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.546594 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.546730 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.546901 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.547037 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.547214 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.547357 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.547520 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.547657 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.547839 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.547979 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.548146 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.548386 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.548534 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.548708 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.548862 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.549071 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.549218 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.549382 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.549533 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.549675 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.549808 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.550001 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.550135 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.550316 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.550461 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.550625 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.550769 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.550935 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.551078 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.551242 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.551393 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.551596 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.551740 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.551873 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.552012 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.552159 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.552293 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.552466 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.552610 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.552776 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.552943 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.553111 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.553268 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.553470 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.553606 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.553747 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.553894 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.554036 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.554261 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.554397 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.554618 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.554761 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.554903 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.555026 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.555188 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.555324 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.555494 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.555638 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.555802 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.555938 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.556129 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.556265 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.556444 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.556661 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.556853 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.557000 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.557134 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.557273 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.557416 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.557559 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.557695 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.557824 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.558505 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.558658 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.558846 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.559165 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.559299 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.559484 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.559620 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.559797 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.559942 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.560116 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.560260 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.560428 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.560573 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.560762 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.560918 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.561102 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.561239 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.561421 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.561570 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.561784 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.561923 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.562062 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.562202 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.562341 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.562473 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.562635 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.562772 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.562945 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.563081 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.563256 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.563401 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.563615 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.563759 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.563894 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.564025 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.564157 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.564303 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.564463 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.564614 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.564874 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.565025 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.565148 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.565289 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.565423 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.565570 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.565703 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.565842 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.566014 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.566159 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.566325 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.566462 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.566634 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.566779 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.566947 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.567093 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.567261 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.567402 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.567575 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.567718 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.567891 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.568035 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.568205 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.568347 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.568513 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.568648 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.568848 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.568988 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.569166 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.569421 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.569566 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.569761 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.569912 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.570089 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.570227 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.570393 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.570535 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.570710 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.570858 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.571020 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.571166 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.571337 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.571474 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.571646 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.571798 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.572009 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.572152 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.572287 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.572426 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.572591 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.572728 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.572934 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.573072 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.573254 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.573391 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.573573 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.574312 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.574448 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.574743 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.574966 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.575114 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.575248 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.575540 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.575684 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.575881 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.576017 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.576233 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.576371 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.576564 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.576708 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.576905 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.577050 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.577217 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.577355 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.577525 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.577671 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.577841 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.577978 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.578158 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.578303 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.578464 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.578607 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.578774 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.578923 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.579082 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.579219 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.579407 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.579550 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.579714 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.579930 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.580070 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.580208 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.580449 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.580594 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.580765 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.580936 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.581101 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.581236 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.581520 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.581663 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.581835 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.581987 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.582196 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.582341 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.582483 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.582630 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.582763 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.582895 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.583088 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.583231 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.583401 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.583545 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.583720 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.583935 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.584079 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.584220 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.584353 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.584484 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.584660 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.584838 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.584998 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.585204 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.585348 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.585489 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.585624 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.585753 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.585920 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.586056 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.586246 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.586391 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.586564 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.586707 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.586889 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.587026 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.587205 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.587352 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.587524 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.587669 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.587853 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.587998 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.588172 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.588310 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.588501 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.588637 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.588837 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.588979 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.589159 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.589360 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.589683 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.589989 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.590135 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.590303 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.590455 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.590626 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.590772 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.590945 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.591093 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.591512 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.591663 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.591834 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.591977 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.592232 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.592385 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.592518 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.592660 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.592843 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.592990 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.593124 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.593256 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.593401 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.593534 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.593703 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.593848 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.594060 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.594202 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.594347 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.594487 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.594647 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.594790 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.594974 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.595117 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.595343 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.595480 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.595630 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.595773 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.595913 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.596053 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.596186 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.596317 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.596489 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.596633 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.596816 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.596974 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.597137 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.597280 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.597463 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.597599 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.597772 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.597926 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.598102 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.598239 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.598429 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.598565 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.598742 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.598888 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.599063 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.599207 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.599383 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.599521 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.599705 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.599839 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.600022 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.600165 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.600348 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.600490 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.600659 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.600819 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.601000 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.601137 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.601310 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.601449 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.601620 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.601758 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.601929 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.602098 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.602409 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.602638 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.602778 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.602920 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.603062 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.603196 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.603328 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.603473 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.603607 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.603740 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.603880 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.604036 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.604246 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.604392 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.604534 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.604673 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 07 04:53:03.604895 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.605081 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.605754 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.606066 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.606416 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.606727 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.607064 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.607386 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.607713 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.608047 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.608364 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.608694 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.609386 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.609386 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.609682 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.610007 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.610330 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.610655 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.610977 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.611291 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.611615 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.611938 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.612259 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.614623 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.614623 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.614623 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.614623 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.614623 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.614623 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.615706 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.615706 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.615706 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.615706 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.616220 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.616220 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.616544 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.616904 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.617252 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.617575 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.617895 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.618215 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.618541 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.618909 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.619235 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.619547 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.619871 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.620196 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.621051 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.621977 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.622310 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.622634 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.622959 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.623283 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.624373 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.624373 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.624373 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.625024 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.625024 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.625262 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.625521 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.625845 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.626168 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.626721 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.627039 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.627391 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.627712 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.628041 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.628475 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.628585 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_db.sqlalchemy.engines [None req-d710f2dc-afba-441a-b38b-f40a56b2f5b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107485) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 04:53:03.628712 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.629034 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.629349 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.630446 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.630799 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.631129 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.631438 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.631776 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.632097 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.632412 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.632742 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.633098 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.633688 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.634047 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.634373 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.634789 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.635034 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.635360 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.635674 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.636006 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.637088 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.637962 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.638298 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.638623 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.638943 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.639259 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.639583 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.639903 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.640215 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.640533 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.640872 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.641213 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.641528 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.641840 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.642151 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.642470 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.642782 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.643108 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.643411 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.643722 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.644038 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.644348 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.644660 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.645006 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.645329 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.645640 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.645956 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.646265 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.646603 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.646913 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.647221 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.647547 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.647862 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.648187 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.648504 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.648845 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.649206 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.649533 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.650132 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.650473 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.650797 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.651149 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.651490 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.651833 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.653140 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.653140 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.653469 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.653800 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.654135 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.654417 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.654735 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.655053 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.655369 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.655685 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.656001 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.656558 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.656922 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.657271 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.657591 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.658204 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.658204 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.658536 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.658856 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.659183 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.659489 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.659819 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.660337 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.660505 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.660783 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.661390 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.661838 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.662164 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.662574 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.662816 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.663138 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.663476 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.663830 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.664165 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.664498 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.664833 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.665151 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.665460 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.665776 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.666127 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.666468 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.666852 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.667120 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.668028 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.669080 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.669413 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.669745 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.670069 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.670550 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.670707 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.671030 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.671362 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.671681 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.672017 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.672334 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.672660 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.672998 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.673319 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.673643 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.673964 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.674307 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.674627 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.674956 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.675274 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.675601 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.675915 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.676243 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.676570 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.676996 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.677234 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.677572 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.677888 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.678209 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.678523 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.678838 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.679151 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.679464 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.679853 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.680113 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.680711 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.680899 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.681107 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.681435 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.681755 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.682073 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.682411 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.682729 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.683148 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.684593 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.684961 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.685295 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.685640 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.685976 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.686308 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.686641 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.686973 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.687339 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.687661 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.688014 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.688370 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 04:53:03.688593 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 07 04:53:03.713651 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_db.sqlalchemy.engines [None req-914e09e0-542b-4dd6-a97f-681e65ac4c4f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107486) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 04:53:03.808166 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.context [None req-d710f2dc-afba-441a-b38b-f40a56b2f5b7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a0405fdb-5261-4cd0-aff8-05e581b9a634(cell1) {{(pid=107485) load_cells /opt/stack/nova/nova/context.py:464}} Aug 07 04:53:03.813147 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d710f2dc-afba-441a-b38b-f40a56b2f5b7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:53:03.814781 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d710f2dc-afba-441a-b38b-f40a56b2f5b7 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:53:03.815620 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d710f2dc-afba-441a-b38b-f40a56b2f5b7 None None] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:53:03.817639 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d710f2dc-afba-441a-b38b-f40a56b2f5b7 None None] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:53:03.829146 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_db.sqlalchemy.engines [None req-d710f2dc-afba-441a-b38b-f40a56b2f5b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107485) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 04:53:03.831220 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_db.sqlalchemy.engines [None req-d710f2dc-afba-441a-b38b-f40a56b2f5b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107485) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 04:53:03.887069 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.context [None req-914e09e0-542b-4dd6-a97f-681e65ac4c4f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a0405fdb-5261-4cd0-aff8-05e581b9a634(cell1) {{(pid=107486) load_cells /opt/stack/nova/nova/context.py:464}} Aug 07 04:53:03.891802 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-914e09e0-542b-4dd6-a97f-681e65ac4c4f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:53:03.893436 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-914e09e0-542b-4dd6-a97f-681e65ac4c4f None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:53:03.894252 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-914e09e0-542b-4dd6-a97f-681e65ac4c4f None None] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:53:03.896211 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-914e09e0-542b-4dd6-a97f-681e65ac4c4f None None] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:53:03.907059 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_db.sqlalchemy.engines [None req-914e09e0-542b-4dd6-a97f-681e65ac4c4f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107486) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 04:53:03.909722 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_db.sqlalchemy.engines [None req-914e09e0-542b-4dd6-a97f-681e65ac4c4f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107486) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 04:53:04.099269 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_db.sqlalchemy.engines [None req-d710f2dc-afba-441a-b38b-f40a56b2f5b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107485) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 04:53:04.181514 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_db.sqlalchemy.engines [None req-914e09e0-542b-4dd6-a97f-681e65ac4c4f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107486) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 04:53:04.480033 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: WARNING keystonemiddleware.auth_token [None req-d710f2dc-afba-441a-b38b-f40a56b2f5b7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 07 04:53:04.486598 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: WARNING keystonemiddleware.auth_token [None req-d710f2dc-afba-441a-b38b-f40a56b2f5b7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 07 04:53:04.513438 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: WARNING keystonemiddleware.auth_token [None req-914e09e0-542b-4dd6-a97f-681e65ac4c4f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 07 04:53:04.519959 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: WARNING keystonemiddleware.auth_token [None req-914e09e0-542b-4dd6-a97f-681e65ac4c4f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 07 04:53:04.832035 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: WARNING keystonemiddleware.auth_token [None req-d710f2dc-afba-441a-b38b-f40a56b2f5b7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 07 04:53:04.837257 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: WARNING keystonemiddleware.auth_token [None req-d710f2dc-afba-441a-b38b-f40a56b2f5b7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 07 04:53:04.843699 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e8bb60f9c0 pid: 107485 (default app) Aug 07 04:53:04.865930 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: WARNING keystonemiddleware.auth_token [None req-914e09e0-542b-4dd6-a97f-681e65ac4c4f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 07 04:53:04.871356 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: WARNING keystonemiddleware.auth_token [None req-914e09e0-542b-4dd6-a97f-681e65ac4c4f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 07 04:53:04.876468 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e8bb60f9c0 pid: 107486 (default app) Aug 07 04:53:38.583776 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-a466e506-7340-4e13-be9d-81b60ce99063 tempest-VolumesGetTestJSON-221040100 tempest-VolumesGetTestJSON-221040100-project] Action: 'create', calling method: .version_select at 0x7f75f9e5f820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-573817199", "metadata": {"Type": "work"}}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:53:38.642349 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-51ee083d-1ff2-41a3-bc95-3a5f553a4a5c tempest-VolumesNegativeTest-1000117062 tempest-VolumesNegativeTest-1000117062-project] Action: 'create', calling method: .version_select at 0x7f75f9e5b820>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1756218424", "metadata": {"Type": "work"}}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:53:38.654567 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-51ee083d-1ff2-41a3-bc95-3a5f553a4a5c tempest-VolumesNegativeTest-1000117062 tempest-VolumesNegativeTest-1000117062-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=107485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 07 04:53:38.655554 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-51ee083d-1ff2-41a3-bc95-3a5f553a4a5c tempest-VolumesNegativeTest-1000117062 tempest-VolumesNegativeTest-1000117062-project] 10.222.0.35 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.605479 Aug 07 04:53:38.656124 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 1/1] 10.222.0.35 () {60 vars in 1156 bytes} [Sat Aug 7 04:53:37 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 1608 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 04:53:38.671396 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-3a75a7dd-04a3-412f-bae2-fd0111a83401 tempest-VolumesNegativeTest-1000117062 tempest-VolumesNegativeTest-1000117062-project] Action: 'create', calling method: .version_select at 0x7f75f9e263a0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1015393253", "metadata": {"Type": "work"}}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:53:38.674957 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-3a75a7dd-04a3-412f-bae2-fd0111a83401 tempest-VolumesNegativeTest-1000117062 tempest-VolumesNegativeTest-1000117062-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=107485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 07 04:53:38.675793 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-3a75a7dd-04a3-412f-bae2-fd0111a83401 tempest-VolumesNegativeTest-1000117062 tempest-VolumesNegativeTest-1000117062-project] 10.222.0.35 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008524 Aug 07 04:53:38.681941 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 2/2] 10.222.0.35 () {60 vars in 1156 bytes} [Sat Aug 7 04:53:38 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 04:53:38.687635 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-46100784-48f9-4b4a-a4c7-6d386132595a tempest-VolumesNegativeTest-1000117062 tempest-VolumesNegativeTest-1000117062-project] Action: 'create', calling method: .version_select at 0x7f75f9e5bf70>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2111918492", "metadata": {"Type": "work"}}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:53:38.689039 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-46100784-48f9-4b4a-a4c7-6d386132595a tempest-VolumesNegativeTest-1000117062 tempest-VolumesNegativeTest-1000117062-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=107485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 07 04:53:38.690001 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-46100784-48f9-4b4a-a4c7-6d386132595a tempest-VolumesNegativeTest-1000117062 tempest-VolumesNegativeTest-1000117062-project] 10.222.0.35 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006750 Aug 07 04:53:38.690663 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 3/3] 10.222.0.35 () {60 vars in 1156 bytes} [Sat Aug 7 04:53:38 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 04:53:38.700907 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-f93665c3-66ff-478c-9b1d-b6155137f3b6 tempest-VolumesNegativeTest-1000117062 tempest-VolumesNegativeTest-1000117062-project] Calling method '.version_select at 0x7f75f9e533a0>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:53:39.749620 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.wsgi [None req-f93665c3-66ff-478c-9b1d-b6155137f3b6 tempest-VolumesNegativeTest-1000117062 tempest-VolumesNegativeTest-1000117062-project] HTTP exception thrown: Volume tempest-invalid-1322065867 could not be found. Aug 07 04:53:39.750373 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-f93665c3-66ff-478c-9b1d-b6155137f3b6 tempest-VolumesNegativeTest-1000117062 tempest-VolumesNegativeTest-1000117062-project] Returning 404 to user: Volume tempest-invalid-1322065867 could not be found. {{(pid=107485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 07 04:53:39.751276 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-f93665c3-66ff-478c-9b1d-b6155137f3b6 tempest-VolumesNegativeTest-1000117062 tempest-VolumesNegativeTest-1000117062-project] 10.222.0.35 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1322065867" status: 404 len: 99 microversion: 2.1 time: 1.054536 Aug 07 04:53:39.757951 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 4/4] 10.222.0.35 () {58 vars in 1218 bytes} [Sat Aug 7 04:53:38 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1322065867 => generated 99 bytes in 1062 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 07 04:53:40.073293 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-812ecb99-90e6-49d1-9f0a-fa5e7bdbbe7e tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1913675408", "imageRef": "ddcf95b5-3ea4-4a61-8f54-4b2feadb8682", "flavorRef": "452", "networks": [{"uuid": "c0e4a04f-a799-47ad-9475-bb3ebbb61692"}]}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:53:40.322934 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.network.neutron [None req-812ecb99-90e6-49d1-9f0a-fa5e7bdbbe7e tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] validate_networks() for [('c0e4a04f-a799-47ad-9475-bb3ebbb61692', None, None, None)] {{(pid=107485) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 07 04:53:40.702980 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-a466e506-7340-4e13-be9d-81b60ce99063 tempest-VolumesGetTestJSON-221040100 tempest-VolumesGetTestJSON-221040100-project] 10.222.0.35 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.461370 Aug 07 04:53:40.703743 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 1/5] 10.222.0.35 () {60 vars in 1156 bytes} [Sat Aug 7 04:53:37 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 3465 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 07 04:53:40.944615 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-1f08dcdd-6924-4696-98ba-446a4b285881 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1723517713", "imageRef": "ddcf95b5-3ea4-4a61-8f54-4b2feadb8682", "flavorRef": "452", "networks": [{"uuid": "69f1fe1f-8945-4293-ba92-135a006394e5"}]}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:53:41.098600 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.network.neutron [None req-1f08dcdd-6924-4696-98ba-446a4b285881 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] validate_networks() for [('69f1fe1f-8945-4293-ba92-135a006394e5', None, None, None)] {{(pid=107486) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 07 04:53:41.857540 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.virt.hardware [None req-812ecb99-90e6-49d1-9f0a-fa5e7bdbbe7e tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Flavor limits 0:0:0 {{(pid=107485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 04:53:41.858110 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.virt.hardware [None req-812ecb99-90e6-49d1-9f0a-fa5e7bdbbe7e tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Image limits 0:0:0 {{(pid=107485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 04:53:41.858600 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.virt.hardware [None req-812ecb99-90e6-49d1-9f0a-fa5e7bdbbe7e tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Flavor pref 0:0:0 {{(pid=107485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 04:53:41.862124 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.virt.hardware [None req-812ecb99-90e6-49d1-9f0a-fa5e7bdbbe7e tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Image pref 0:0:0 {{(pid=107485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 04:53:41.862580 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.virt.hardware [None req-812ecb99-90e6-49d1-9f0a-fa5e7bdbbe7e tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 04:53:41.885306 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-812ecb99-90e6-49d1-9f0a-fa5e7bdbbe7e tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:53:41.885780 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-812ecb99-90e6-49d1-9f0a-fa5e7bdbbe7e tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:53:41.886626 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-812ecb99-90e6-49d1-9f0a-fa5e7bdbbe7e tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:53:41.890895 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-812ecb99-90e6-49d1-9f0a-fa5e7bdbbe7e tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:53:41.969506 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.quota [None req-812ecb99-90e6-49d1-9f0a-fa5e7bdbbe7e tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Getting quotas for project 56d51e070d184693b32f62e300ded4fa. Resources: {'ram', 'cores', 'instances'} {{(pid=107485) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 07 04:53:41.986210 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.quota [None req-812ecb99-90e6-49d1-9f0a-fa5e7bdbbe7e tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Getting quotas for user d1a3194159fb47cdb59335fc442ad6dc and project 56d51e070d184693b32f62e300ded4fa. Resources: {'ram', 'cores', 'instances'} {{(pid=107485) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 07 04:53:42.006176 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-812ecb99-90e6-49d1-9f0a-fa5e7bdbbe7e tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Going to run 1 instances... {{(pid=107485) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 07 04:53:42.009691 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-812ecb99-90e6-49d1-9f0a-fa5e7bdbbe7e tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ddcf95b5-3ea4-4a61-8f54-4b2feadb8682',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107485) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 07 04:53:42.174742 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-812ecb99-90e6-49d1-9f0a-fa5e7bdbbe7e tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.415461 Aug 07 04:53:42.175951 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 5/6] 10.222.0.35 () {60 vars in 1147 bytes} [Sat Aug 7 04:53:39 2021] POST /compute/v2.1/servers => generated 380 bytes in 2417 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 04:53:42.184844 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-8780117b-b8e3-4df7-af77-e576dfe41047 tempest-VolumesNegativeTest-1000117062 tempest-VolumesNegativeTest-1000117062-project] 10.222.0.35 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004793 Aug 07 04:53:42.190130 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 6/7] 10.222.0.35 () {58 vars in 1140 bytes} [Sat Aug 7 04:53:42 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 07 04:53:42.208082 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-d86e4a9e-0f46-436e-9433-98547f7d9d60 tempest-VolumesGetTestJSON-221040100 tempest-VolumesGetTestJSON-221040100-project] Calling method '.version_select at 0x7f75f9c379d0>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:53:42.385095 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.virt.hardware [None req-1f08dcdd-6924-4696-98ba-446a4b285881 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Flavor limits 0:0:0 {{(pid=107486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 04:53:42.386685 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.virt.hardware [None req-1f08dcdd-6924-4696-98ba-446a4b285881 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Image limits 0:0:0 {{(pid=107486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 04:53:42.387258 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.virt.hardware [None req-1f08dcdd-6924-4696-98ba-446a4b285881 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Flavor pref 0:0:0 {{(pid=107486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 04:53:42.387825 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.virt.hardware [None req-1f08dcdd-6924-4696-98ba-446a4b285881 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Image pref 0:0:0 {{(pid=107486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 04:53:42.388401 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.virt.hardware [None req-1f08dcdd-6924-4696-98ba-446a4b285881 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 04:53:42.425966 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1f08dcdd-6924-4696-98ba-446a4b285881 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:53:42.426512 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1f08dcdd-6924-4696-98ba-446a4b285881 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:53:42.427284 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1f08dcdd-6924-4696-98ba-446a4b285881 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:53:42.427732 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1f08dcdd-6924-4696-98ba-446a4b285881 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:53:42.439324 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-d86e4a9e-0f46-436e-9433-98547f7d9d60 tempest-VolumesGetTestJSON-221040100 tempest-VolumesGetTestJSON-221040100-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/452cabd6-bb47-4e17-a49a-b6f06004eda0" status: 200 len: 353 microversion: 2.1 time: 0.247450 Aug 07 04:53:42.447167 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 7/8] 10.222.0.35 () {58 vars in 1245 bytes} [Sat Aug 7 04:53:42 2021] GET /compute/v2.1/os-volumes/452cabd6-bb47-4e17-a49a-b6f06004eda0 => generated 353 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:53:42.454240 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-246c3301-ca7b-4f6f-ad1c-0eb816180e7b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:53:42.456110 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-246c3301-ca7b-4f6f-ad1c-0eb816180e7b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:53:42.539586 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.quota [None req-1f08dcdd-6924-4696-98ba-446a4b285881 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Getting quotas for project dbad771114b14d1c813e85f39291b826. Resources: {'ram', 'cores', 'instances'} {{(pid=107486) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 07 04:53:42.570041 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.quota [None req-1f08dcdd-6924-4696-98ba-446a4b285881 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Getting quotas for user dafa958efbec43feaf2a6341496d7eb0 and project dbad771114b14d1c813e85f39291b826. Resources: {'ram', 'cores', 'instances'} {{(pid=107486) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 07 04:53:42.606185 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-1f08dcdd-6924-4696-98ba-446a4b285881 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Going to run 1 instances... {{(pid=107486) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 07 04:53:42.631477 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-1f08dcdd-6924-4696-98ba-446a4b285881 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] [instance: ebbb4a6b-6863-4efc-8e24-5073fcf14368] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ddcf95b5-3ea4-4a61-8f54-4b2feadb8682',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107486) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 07 04:53:42.822073 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-1f08dcdd-6924-4696-98ba-446a4b285881 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.116849 Aug 07 04:53:42.823280 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 2/9] 10.222.0.35 () {60 vars in 1147 bytes} [Sat Aug 7 04:53:40 2021] POST /compute/v2.1/servers => generated 380 bytes in 2119 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 04:53:42.830703 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-06733990-bda4-413f-a9c4-63fe58eed79b tempest-VolumesNegativeTest-1000117062 tempest-VolumesNegativeTest-1000117062-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004011 Aug 07 04:53:42.835372 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 3/10] 10.222.0.35 () {58 vars in 1137 bytes} [Sat Aug 7 04:53:42 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 07 04:53:42.848647 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-5651aba5-76ab-45a9-9481-e042a2149549 tempest-VolumesGetTestJSON-221040100 tempest-VolumesGetTestJSON-221040100-project] Calling method '.version_select at 0x7f75f9c33a60>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:53:42.953120 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-5651aba5-76ab-45a9-9481-e042a2149549 tempest-VolumesGetTestJSON-221040100 tempest-VolumesGetTestJSON-221040100-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/452cabd6-bb47-4e17-a49a-b6f06004eda0" status: 200 len: 353 microversion: 2.1 time: 0.116317 Aug 07 04:53:42.955762 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 4/11] 10.222.0.35 () {58 vars in 1245 bytes} [Sat Aug 7 04:53:42 2021] GET /compute/v2.1/os-volumes/452cabd6-bb47-4e17-a49a-b6f06004eda0 => generated 353 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:53:42.962837 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-9e9e9392-14b5-4478-b273-2f26d4672693 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:53:42.964874 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-9e9e9392-14b5-4478-b273-2f26d4672693 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] [instance: ebbb4a6b-6863-4efc-8e24-5073fcf14368] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:53:43.127227 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-246c3301-ca7b-4f6f-ad1c-0eb816180e7b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:53:43.155172 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-246c3301-ca7b-4f6f-ad1c-0eb816180e7b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b" status: 200 len: 1218 microversion: 2.1 time: 0.706619 Aug 07 04:53:43.156143 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 8/12] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:53:42 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b => generated 1218 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:53:43.169353 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-d5cad124-173e-454f-8fea-61e0d99d142b tempest-VolumesNegativeTest-1000117062 tempest-VolumesNegativeTest-1000117062-project] Calling method '.version_select at 0x7f75f93e1430>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:53:43.173792 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-9e9e9392-14b5-4478-b273-2f26d4672693 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa958efbec43feaf2a6341496d7eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbad771114b14d1c813e85f39291b826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:53:43.217125 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-9e9e9392-14b5-4478-b273-2f26d4672693 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] 10.222.0.35 "GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368" status: 200 len: 1215 microversion: 2.1 time: 0.257205 Aug 07 04:53:43.217671 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 5/13] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:53:42 2021] GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368 => generated 1215 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:53:43.222942 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.wsgi [None req-d5cad124-173e-454f-8fea-61e0d99d142b tempest-VolumesNegativeTest-1000117062 tempest-VolumesNegativeTest-1000117062-project] HTTP exception thrown: Volume 409a19da-57cf-48a6-9db3-622b90c497ef could not be found. Aug 07 04:53:43.223554 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-d5cad124-173e-454f-8fea-61e0d99d142b tempest-VolumesNegativeTest-1000117062 tempest-VolumesNegativeTest-1000117062-project] Returning 404 to user: Volume 409a19da-57cf-48a6-9db3-622b90c497ef could not be found. {{(pid=107485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 07 04:53:43.224611 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-d5cad124-173e-454f-8fea-61e0d99d142b tempest-VolumesNegativeTest-1000117062 tempest-VolumesNegativeTest-1000117062-project] 10.222.0.35 "DELETE /compute/v2.1/os-volumes/409a19da-57cf-48a6-9db3-622b90c497ef" status: 404 len: 109 microversion: 2.1 time: 0.065291 Aug 07 04:53:43.231575 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 9/14] 10.222.0.35 () {58 vars in 1248 bytes} [Sat Aug 7 04:53:43 2021] DELETE /compute/v2.1/os-volumes/409a19da-57cf-48a6-9db3-622b90c497ef => generated 109 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 04:53:43.239869 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-a892a526-745c-42cd-9de5-daf75be9b8e3 tempest-VolumesNegativeTest-1000117062 tempest-VolumesNegativeTest-1000117062-project] Calling method '.version_select at 0x7f75f93f5a60>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:53:43.251425 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-38a40077-9d3e-4bf5-b94b-2a354c7ddb6b tempest-VolumesGetTestJSON-221040100 tempest-VolumesGetTestJSON-221040100-project] Calling method '.version_select at 0x7f75f9c33ee0>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:53:43.308664 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.wsgi [None req-a892a526-745c-42cd-9de5-daf75be9b8e3 tempest-VolumesNegativeTest-1000117062 tempest-VolumesNegativeTest-1000117062-project] HTTP exception thrown: Volume 05803142-5518-4e72-a779-a5f48b8cf188 could not be found. Aug 07 04:53:43.309608 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-a892a526-745c-42cd-9de5-daf75be9b8e3 tempest-VolumesNegativeTest-1000117062 tempest-VolumesNegativeTest-1000117062-project] Returning 404 to user: Volume 05803142-5518-4e72-a779-a5f48b8cf188 could not be found. {{(pid=107485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 07 04:53:43.310731 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-a892a526-745c-42cd-9de5-daf75be9b8e3 tempest-VolumesNegativeTest-1000117062 tempest-VolumesNegativeTest-1000117062-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/05803142-5518-4e72-a779-a5f48b8cf188" status: 404 len: 109 microversion: 2.1 time: 0.077765 Aug 07 04:53:43.311431 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 10/15] 10.222.0.35 () {58 vars in 1245 bytes} [Sat Aug 7 04:53:43 2021] GET /compute/v2.1/os-volumes/05803142-5518-4e72-a779-a5f48b8cf188 => generated 109 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 04:53:43.456399 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-38a40077-9d3e-4bf5-b94b-2a354c7ddb6b tempest-VolumesGetTestJSON-221040100 tempest-VolumesGetTestJSON-221040100-project] 10.222.0.35 "DELETE /compute/v2.1/os-volumes/452cabd6-bb47-4e17-a49a-b6f06004eda0" status: 202 len: 0 microversion: 2.1 time: 0.236110 Aug 07 04:53:43.464890 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 6/16] 10.222.0.35 () {58 vars in 1248 bytes} [Sat Aug 7 04:53:43 2021] DELETE /compute/v2.1/os-volumes/452cabd6-bb47-4e17-a49a-b6f06004eda0 => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:53:43.466650 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-174df2fd-3047-4326-a656-22eac3cbe527 tempest-VolumesGetTestJSON-221040100 tempest-VolumesGetTestJSON-221040100-project] Calling method '.version_select at 0x7f75f93f5b80>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:53:43.597512 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-174df2fd-3047-4326-a656-22eac3cbe527 tempest-VolumesGetTestJSON-221040100 tempest-VolumesGetTestJSON-221040100-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/452cabd6-bb47-4e17-a49a-b6f06004eda0" status: 200 len: 352 microversion: 2.1 time: 0.135159 Aug 07 04:53:43.598078 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 11/17] 10.222.0.35 () {58 vars in 1245 bytes} [Sat Aug 7 04:53:43 2021] GET /compute/v2.1/os-volumes/452cabd6-bb47-4e17-a49a-b6f06004eda0 => generated 352 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:53:44.179921 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-c69eb77c-5cf6-41a9-9900-4026d883d004 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:53:44.186192 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-c69eb77c-5cf6-41a9-9900-4026d883d004 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:53:44.240426 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-fb42915a-1a06-48d7-9612-343a887c150f tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:53:44.241743 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-fb42915a-1a06-48d7-9612-343a887c150f tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] [instance: ebbb4a6b-6863-4efc-8e24-5073fcf14368] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:53:44.499353 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-c69eb77c-5cf6-41a9-9900-4026d883d004 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:53:44.513199 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-c69eb77c-5cf6-41a9-9900-4026d883d004 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b" status: 200 len: 1218 microversion: 2.1 time: 0.344747 Aug 07 04:53:44.518625 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 7/18] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:53:44 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b => generated 1218 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:53:44.610821 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-359dd4ed-0aeb-44f1-979f-4feaf5a42a7b tempest-VolumesGetTestJSON-221040100 tempest-VolumesGetTestJSON-221040100-project] Calling method '.version_select at 0x7f75f93f4af0>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:53:44.675007 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.wsgi [None req-359dd4ed-0aeb-44f1-979f-4feaf5a42a7b tempest-VolumesGetTestJSON-221040100 tempest-VolumesGetTestJSON-221040100-project] HTTP exception thrown: Volume 452cabd6-bb47-4e17-a49a-b6f06004eda0 could not be found. Aug 07 04:53:44.675867 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-359dd4ed-0aeb-44f1-979f-4feaf5a42a7b tempest-VolumesGetTestJSON-221040100 tempest-VolumesGetTestJSON-221040100-project] Returning 404 to user: Volume 452cabd6-bb47-4e17-a49a-b6f06004eda0 could not be found. {{(pid=107486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 07 04:53:44.677073 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-359dd4ed-0aeb-44f1-979f-4feaf5a42a7b tempest-VolumesGetTestJSON-221040100 tempest-VolumesGetTestJSON-221040100-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/452cabd6-bb47-4e17-a49a-b6f06004eda0" status: 404 len: 109 microversion: 2.1 time: 0.070514 Aug 07 04:53:44.681048 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 8/19] 10.222.0.35 () {58 vars in 1245 bytes} [Sat Aug 7 04:53:44 2021] GET /compute/v2.1/os-volumes/452cabd6-bb47-4e17-a49a-b6f06004eda0 => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 04:53:44.953208 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-fb42915a-1a06-48d7-9612-343a887c150f tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa958efbec43feaf2a6341496d7eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbad771114b14d1c813e85f39291b826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:53:44.969893 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-fb42915a-1a06-48d7-9612-343a887c150f tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] 10.222.0.35 "GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368" status: 200 len: 1215 microversion: 2.1 time: 0.734242 Aug 07 04:53:44.972229 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 12/20] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:53:44 2021] GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368 => generated 1215 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:53:45.541058 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-9ec806f8-7720-4945-b698-7d7a0d416d26 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:53:45.542437 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-9ec806f8-7720-4945-b698-7d7a0d416d26 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:53:45.556646 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9ec806f8-7720-4945-b698-7d7a0d416d26 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:53:45.557434 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9ec806f8-7720-4945-b698-7d7a0d416d26 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:53:45.561190 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9ec806f8-7720-4945-b698-7d7a0d416d26 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:53:45.561928 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9ec806f8-7720-4945-b698-7d7a0d416d26 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:53:45.867914 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-9ec806f8-7720-4945-b698-7d7a0d416d26 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:53:45.889336 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-9ec806f8-7720-4945-b698-7d7a0d416d26 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b" status: 200 len: 1214 microversion: 2.1 time: 0.355815 Aug 07 04:53:45.892318 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 9/21] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:53:45 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b => generated 1214 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:53:45.989893 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-f9e305aa-13d0-4735-bc39-bf3ddc86fa8e tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:53:45.994023 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-f9e305aa-13d0-4735-bc39-bf3ddc86fa8e tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] [instance: ebbb4a6b-6863-4efc-8e24-5073fcf14368] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:53:46.017032 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f9e305aa-13d0-4735-bc39-bf3ddc86fa8e tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:53:46.020025 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f9e305aa-13d0-4735-bc39-bf3ddc86fa8e tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:53:46.024281 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f9e305aa-13d0-4735-bc39-bf3ddc86fa8e tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:53:46.028463 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f9e305aa-13d0-4735-bc39-bf3ddc86fa8e tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:53:46.437718 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-f9e305aa-13d0-4735-bc39-bf3ddc86fa8e tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa958efbec43feaf2a6341496d7eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbad771114b14d1c813e85f39291b826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:53:46.463242 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-f9e305aa-13d0-4735-bc39-bf3ddc86fa8e tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] 10.222.0.35 "GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368" status: 200 len: 1275 microversion: 2.1 time: 0.477262 Aug 07 04:53:46.472775 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 13/22] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:53:45 2021] GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368 => generated 1275 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:53:46.907891 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-336f384d-1656-40cb-9fc4-2f3034224bc3 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:53:46.908515 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-336f384d-1656-40cb-9fc4-2f3034224bc3 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:53:46.922514 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-336f384d-1656-40cb-9fc4-2f3034224bc3 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:53:46.923020 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-336f384d-1656-40cb-9fc4-2f3034224bc3 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:53:46.928986 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-336f384d-1656-40cb-9fc4-2f3034224bc3 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:53:46.929789 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-336f384d-1656-40cb-9fc4-2f3034224bc3 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:53:47.123257 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-336f384d-1656-40cb-9fc4-2f3034224bc3 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:53:47.130736 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-336f384d-1656-40cb-9fc4-2f3034224bc3 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b" status: 200 len: 1288 microversion: 2.1 time: 0.226802 Aug 07 04:53:47.135269 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 10/23] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:53:46 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b => generated 1288 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:53:47.489244 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-bb4692ac-95f1-4469-a97e-27bb449670f0 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:53:47.489777 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-bb4692ac-95f1-4469-a97e-27bb449670f0 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] [instance: ebbb4a6b-6863-4efc-8e24-5073fcf14368] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:53:47.501578 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-bb4692ac-95f1-4469-a97e-27bb449670f0 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:53:47.502030 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-bb4692ac-95f1-4469-a97e-27bb449670f0 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:53:47.503004 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-bb4692ac-95f1-4469-a97e-27bb449670f0 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:53:47.503450 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-bb4692ac-95f1-4469-a97e-27bb449670f0 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:53:47.804710 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-bb4692ac-95f1-4469-a97e-27bb449670f0 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa958efbec43feaf2a6341496d7eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbad771114b14d1c813e85f39291b826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:53:47.815892 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-bb4692ac-95f1-4469-a97e-27bb449670f0 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] 10.222.0.35 "GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368" status: 200 len: 1273 microversion: 2.1 time: 0.330591 Aug 07 04:53:47.824335 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 14/24] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:53:47 2021] GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368 => generated 1273 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:53:48.150198 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-68eb2676-9376-46fb-ba5d-c6780f9e31f3 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:53:48.151042 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-68eb2676-9376-46fb-ba5d-c6780f9e31f3 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:53:48.165182 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-68eb2676-9376-46fb-ba5d-c6780f9e31f3 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:53:48.168323 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-68eb2676-9376-46fb-ba5d-c6780f9e31f3 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:53:48.177489 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-68eb2676-9376-46fb-ba5d-c6780f9e31f3 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:53:48.178171 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-68eb2676-9376-46fb-ba5d-c6780f9e31f3 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:53:48.937806 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-7c03671b-eaa4-470d-aecb-6064f129718e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'create', calling method: .version_select at 0x7f75f9c4a5e0>, body: {"keypair": {"name": "tempest-keypair-755006623"}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:53:49.010486 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-68eb2676-9376-46fb-ba5d-c6780f9e31f3 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:53:49.039366 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-68eb2676-9376-46fb-ba5d-c6780f9e31f3 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b" status: 200 len: 1276 microversion: 2.1 time: 0.893204 Aug 07 04:53:49.046713 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 11/25] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:53:48 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b => generated 1276 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:53:49.059477 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-46b0495c-7bf4-4c09-a91f-fa22d7bead78 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:53:49.065040 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-46b0495c-7bf4-4c09-a91f-fa22d7bead78 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] [instance: ebbb4a6b-6863-4efc-8e24-5073fcf14368] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:53:49.067360 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.quota [None req-7c03671b-eaa4-470d-aecb-6064f129718e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Getting quotas for project 6c23fa4998bf4a8cb6fa05e019c813bd. Resources: {'key_pairs'} {{(pid=107485) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 07 04:53:49.083650 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.quota [None req-7c03671b-eaa4-470d-aecb-6064f129718e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Getting quotas for user 9f3bcbbebe354fe9a2a9ae24d7b792d1 and project 6c23fa4998bf4a8cb6fa05e019c813bd. Resources: {'key_pairs'} {{(pid=107485) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 07 04:53:49.085938 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-46b0495c-7bf4-4c09-a91f-fa22d7bead78 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:53:49.087680 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-46b0495c-7bf4-4c09-a91f-fa22d7bead78 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:53:49.093374 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-46b0495c-7bf4-4c09-a91f-fa22d7bead78 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:53:49.093835 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-46b0495c-7bf4-4c09-a91f-fa22d7bead78 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:53:50.143355 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.quota [None req-7c03671b-eaa4-470d-aecb-6064f129718e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Getting quotas for project 6c23fa4998bf4a8cb6fa05e019c813bd. Resources: {'key_pairs'} {{(pid=107485) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 07 04:53:50.207911 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.quota [None req-7c03671b-eaa4-470d-aecb-6064f129718e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Getting quotas for user 9f3bcbbebe354fe9a2a9ae24d7b792d1 and project 6c23fa4998bf4a8cb6fa05e019c813bd. Resources: {'key_pairs'} {{(pid=107485) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 07 04:53:50.217330 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-7c03671b-eaa4-470d-aecb-6064f129718e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 1.709946 Aug 07 04:53:50.229753 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 15/26] 10.222.0.35 () {62 vars in 1199 bytes} [Sat Aug 7 04:53:48 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 1713 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Aug 07 04:53:50.635004 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-46b0495c-7bf4-4c09-a91f-fa22d7bead78 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa958efbec43feaf2a6341496d7eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbad771114b14d1c813e85f39291b826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:53:50.665761 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-46b0495c-7bf4-4c09-a91f-fa22d7bead78 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] 10.222.0.35 "GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368" status: 200 len: 1315 microversion: 2.1 time: 1.608716 Aug 07 04:53:50.669931 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 12/27] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:53:49 2021] GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368 => generated 1315 bytes in 1622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:53:50.686776 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-375f7a6f-b225-4c28-b07e-88ac6c4553cd tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:53:50.691944 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-375f7a6f-b225-4c28-b07e-88ac6c4553cd tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:53:50.718895 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-375f7a6f-b225-4c28-b07e-88ac6c4553cd tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:53:50.719588 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-375f7a6f-b225-4c28-b07e-88ac6c4553cd tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:53:50.720137 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-375f7a6f-b225-4c28-b07e-88ac6c4553cd tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:53:50.720577 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-375f7a6f-b225-4c28-b07e-88ac6c4553cd tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:53:51.186725 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-375f7a6f-b225-4c28-b07e-88ac6c4553cd tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:53:51.192660 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-e05cd649-2c3c-423c-ba1e-4d6afbb9bd29 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1796995332", "imageRef": "ddcf95b5-3ea4-4a61-8f54-4b2feadb8682", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aed8f1bd-cb13-4093-afc4-79463ed9511a"}]}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:53:51.194302 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-375f7a6f-b225-4c28-b07e-88ac6c4553cd tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b" status: 200 len: 1318 microversion: 2.1 time: 0.520849 Aug 07 04:53:51.194870 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 13/28] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:53:50 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b => generated 1318 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:53:51.318660 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.network.neutron [None req-e05cd649-2c3c-423c-ba1e-4d6afbb9bd29 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] validate_networks() for [('aed8f1bd-cb13-4093-afc4-79463ed9511a', None, None, None)] {{(pid=107485) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 07 04:53:51.685012 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-80d140c7-8f17-4c25-b8d0-bec42cbc38bd tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:53:51.686310 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-80d140c7-8f17-4c25-b8d0-bec42cbc38bd tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] [instance: ebbb4a6b-6863-4efc-8e24-5073fcf14368] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:53:51.699148 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-80d140c7-8f17-4c25-b8d0-bec42cbc38bd tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:53:51.700043 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-80d140c7-8f17-4c25-b8d0-bec42cbc38bd tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:53:51.701136 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-80d140c7-8f17-4c25-b8d0-bec42cbc38bd tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:53:51.701759 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-80d140c7-8f17-4c25-b8d0-bec42cbc38bd tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:53:51.994291 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-80d140c7-8f17-4c25-b8d0-bec42cbc38bd tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa958efbec43feaf2a6341496d7eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbad771114b14d1c813e85f39291b826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:53:52.007967 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-80d140c7-8f17-4c25-b8d0-bec42cbc38bd tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] 10.222.0.35 "GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368" status: 200 len: 1315 microversion: 2.1 time: 0.326952 Aug 07 04:53:52.012847 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 14/29] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:53:51 2021] GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368 => generated 1315 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:53:52.211436 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-2c0c9e86-b4cc-4db1-909b-3e544c7e4a09 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:53:52.212457 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-2c0c9e86-b4cc-4db1-909b-3e544c7e4a09 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:53:52.226956 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2c0c9e86-b4cc-4db1-909b-3e544c7e4a09 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:53:52.228060 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2c0c9e86-b4cc-4db1-909b-3e544c7e4a09 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:53:52.230666 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2c0c9e86-b4cc-4db1-909b-3e544c7e4a09 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:53:52.234077 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2c0c9e86-b4cc-4db1-909b-3e544c7e4a09 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:53:52.815345 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.virt.hardware [None req-e05cd649-2c3c-423c-ba1e-4d6afbb9bd29 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Flavor limits 0:0:0 {{(pid=107485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 04:53:52.817544 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.virt.hardware [None req-e05cd649-2c3c-423c-ba1e-4d6afbb9bd29 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Image limits 0:0:0 {{(pid=107485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 04:53:52.817544 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.virt.hardware [None req-e05cd649-2c3c-423c-ba1e-4d6afbb9bd29 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Flavor pref 0:0:0 {{(pid=107485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 04:53:52.817544 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.virt.hardware [None req-e05cd649-2c3c-423c-ba1e-4d6afbb9bd29 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Image pref 0:0:0 {{(pid=107485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 04:53:52.817544 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.virt.hardware [None req-e05cd649-2c3c-423c-ba1e-4d6afbb9bd29 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 04:53:52.853383 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e05cd649-2c3c-423c-ba1e-4d6afbb9bd29 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:53:52.854141 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e05cd649-2c3c-423c-ba1e-4d6afbb9bd29 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:53:52.856978 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e05cd649-2c3c-423c-ba1e-4d6afbb9bd29 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:53:52.858180 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e05cd649-2c3c-423c-ba1e-4d6afbb9bd29 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:53:52.919460 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.quota [None req-e05cd649-2c3c-423c-ba1e-4d6afbb9bd29 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Getting quotas for project c54c5afb01f5471297a24ec0ece9d506. Resources: {'ram', 'cores', 'instances'} {{(pid=107485) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 07 04:53:52.943699 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.quota [None req-e05cd649-2c3c-423c-ba1e-4d6afbb9bd29 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Getting quotas for user 97aa1bdc4c4f411a81e254f9919962d6 and project c54c5afb01f5471297a24ec0ece9d506. Resources: {'ram', 'cores', 'instances'} {{(pid=107485) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 07 04:53:52.983046 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-e05cd649-2c3c-423c-ba1e-4d6afbb9bd29 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Going to run 1 instances... {{(pid=107485) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 07 04:53:52.992532 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-e05cd649-2c3c-423c-ba1e-4d6afbb9bd29 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ddcf95b5-3ea4-4a61-8f54-4b2feadb8682',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107485) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 07 04:53:53.131008 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-e05cd649-2c3c-423c-ba1e-4d6afbb9bd29 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.899619 Aug 07 04:53:53.141019 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 16/30] 10.222.0.35 () {60 vars in 1147 bytes} [Sat Aug 7 04:53:50 2021] POST /compute/v2.1/servers => generated 383 bytes in 2910 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 04:53:53.163423 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-17eda8e7-098d-4636-8f27-c252d720fc03 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:53:53.164270 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-17eda8e7-098d-4636-8f27-c252d720fc03 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] [instance: ebbb4a6b-6863-4efc-8e24-5073fcf14368] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:53:53.189337 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-17eda8e7-098d-4636-8f27-c252d720fc03 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:53:53.190287 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-17eda8e7-098d-4636-8f27-c252d720fc03 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:53:53.191195 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-17eda8e7-098d-4636-8f27-c252d720fc03 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:53:53.194425 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-17eda8e7-098d-4636-8f27-c252d720fc03 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:53:53.438401 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-2c0c9e86-b4cc-4db1-909b-3e544c7e4a09 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:53:53.446482 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-2c0c9e86-b4cc-4db1-909b-3e544c7e4a09 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b" status: 200 len: 1318 microversion: 2.1 time: 1.238859 Aug 07 04:53:53.477130 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 15/31] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:53:52 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b => generated 1318 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:53:53.494111 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-03e38764-40e8-4b6e-ab48-914c3390344f tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:53:53.494720 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-03e38764-40e8-4b6e-ab48-914c3390344f tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:53:53.715066 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-17eda8e7-098d-4636-8f27-c252d720fc03 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa958efbec43feaf2a6341496d7eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbad771114b14d1c813e85f39291b826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:53:53.728471 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-17eda8e7-098d-4636-8f27-c252d720fc03 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] 10.222.0.35 "GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368" status: 200 len: 1315 microversion: 2.1 time: 0.584806 Aug 07 04:53:53.733110 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 17/32] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:53:53 2021] GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368 => generated 1315 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:53:54.228144 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-03e38764-40e8-4b6e-ab48-914c3390344f tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:53:54.238016 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-03e38764-40e8-4b6e-ab48-914c3390344f tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1222 microversion: 2.1 time: 0.759360 Aug 07 04:53:54.239870 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 16/33] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:53:53 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1222 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:53:54.458590 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-71e3e018-f329-4054-8b95-11f1426fc985 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2020793647", "imageRef": "ddcf95b5-3ea4-4a61-8f54-4b2feadb8682", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aed8f1bd-cb13-4093-afc4-79463ed9511a"}]}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:53:54.488722 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-2daa30c0-85d0-4bb5-8f71-ecaf39002923 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:53:54.489533 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-2daa30c0-85d0-4bb5-8f71-ecaf39002923 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:53:54.500542 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2daa30c0-85d0-4bb5-8f71-ecaf39002923 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:53:54.503596 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2daa30c0-85d0-4bb5-8f71-ecaf39002923 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:53:54.504646 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2daa30c0-85d0-4bb5-8f71-ecaf39002923 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:53:54.508258 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2daa30c0-85d0-4bb5-8f71-ecaf39002923 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:53:54.594827 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.network.neutron [None req-71e3e018-f329-4054-8b95-11f1426fc985 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] validate_networks() for [('aed8f1bd-cb13-4093-afc4-79463ed9511a', None, None, None)] {{(pid=107485) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 07 04:53:55.762018 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-2daa30c0-85d0-4bb5-8f71-ecaf39002923 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:53:55.772288 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-2daa30c0-85d0-4bb5-8f71-ecaf39002923 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b" status: 200 len: 1318 microversion: 2.1 time: 1.287562 Aug 07 04:53:55.785110 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 17/34] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:53:54 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b => generated 1318 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:53:55.792623 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-77984526-7c32-4a32-94bf-bb12d496e24a tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:53:55.794727 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-77984526-7c32-4a32-94bf-bb12d496e24a tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] [instance: ebbb4a6b-6863-4efc-8e24-5073fcf14368] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:53:55.840482 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-77984526-7c32-4a32-94bf-bb12d496e24a tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:53:55.847123 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-77984526-7c32-4a32-94bf-bb12d496e24a tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:53:55.849897 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-77984526-7c32-4a32-94bf-bb12d496e24a tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:53:55.850554 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-77984526-7c32-4a32-94bf-bb12d496e24a tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:53:56.840319 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-77984526-7c32-4a32-94bf-bb12d496e24a tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa958efbec43feaf2a6341496d7eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbad771114b14d1c813e85f39291b826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:53:56.857691 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-77984526-7c32-4a32-94bf-bb12d496e24a tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] 10.222.0.35 "GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368" status: 200 len: 1315 microversion: 2.1 time: 1.071028 Aug 07 04:53:56.868235 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 18/35] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:53:55 2021] GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368 => generated 1315 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:53:57.037309 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.virt.hardware [None req-71e3e018-f329-4054-8b95-11f1426fc985 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Flavor limits 0:0:0 {{(pid=107485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 04:53:57.037901 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.virt.hardware [None req-71e3e018-f329-4054-8b95-11f1426fc985 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Image limits 0:0:0 {{(pid=107485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 04:53:57.038662 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.virt.hardware [None req-71e3e018-f329-4054-8b95-11f1426fc985 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Flavor pref 0:0:0 {{(pid=107485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 04:53:57.040685 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.virt.hardware [None req-71e3e018-f329-4054-8b95-11f1426fc985 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Image pref 0:0:0 {{(pid=107485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 04:53:57.041408 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.virt.hardware [None req-71e3e018-f329-4054-8b95-11f1426fc985 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 04:53:57.062938 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-71e3e018-f329-4054-8b95-11f1426fc985 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:53:57.065117 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-71e3e018-f329-4054-8b95-11f1426fc985 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:53:57.066170 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-71e3e018-f329-4054-8b95-11f1426fc985 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:53:57.068311 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-71e3e018-f329-4054-8b95-11f1426fc985 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:53:57.134252 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.quota [None req-71e3e018-f329-4054-8b95-11f1426fc985 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Getting quotas for project c54c5afb01f5471297a24ec0ece9d506. Resources: {'ram', 'cores', 'instances'} {{(pid=107485) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 07 04:53:57.145947 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.quota [None req-71e3e018-f329-4054-8b95-11f1426fc985 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Getting quotas for user 97aa1bdc4c4f411a81e254f9919962d6 and project c54c5afb01f5471297a24ec0ece9d506. Resources: {'ram', 'cores', 'instances'} {{(pid=107485) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 07 04:53:57.156542 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [req-ca0a1466-f9cc-4080-a0d0-7ddff28fa178 req-02a50b8c-f829-48a0-a53b-977b79a0dc88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebbb4a6b-6863-4efc-8e24-5073fcf14368", "tag": "1b5eb467-65ff-42a9-ae4a-da9f4bbed5d1"}]} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:53:57.158712 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 04:53:57.158712 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: warnings.warn(msg) Aug 07 04:53:57.159218 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-71e3e018-f329-4054-8b95-11f1426fc985 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Going to run 1 instances... {{(pid=107485) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 07 04:53:57.161477 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-71e3e018-f329-4054-8b95-11f1426fc985 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ddcf95b5-3ea4-4a61-8f54-4b2feadb8682',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107485) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 07 04:53:57.197708 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-ca0a1466-f9cc-4080-a0d0-7ddff28fa178 req-02a50b8c-f829-48a0-a53b-977b79a0dc88 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:53:57.198342 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-ca0a1466-f9cc-4080-a0d0-7ddff28fa178 req-02a50b8c-f829-48a0-a53b-977b79a0dc88 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:53:57.246440 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-71e3e018-f329-4054-8b95-11f1426fc985 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.805552 Aug 07 04:53:57.250549 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 18/36] 10.222.0.35 () {60 vars in 1147 bytes} [Sat Aug 7 04:53:54 2021] POST /compute/v2.1/servers => generated 383 bytes in 2812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 04:53:57.267807 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-22593c3e-6c6a-4b4c-9250-7e892e1a8193 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:53:57.268441 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-22593c3e-6c6a-4b4c-9250-7e892e1a8193 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:53:57.269480 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.compute.server_external_events [req-ca0a1466-f9cc-4080-a0d0-7ddff28fa178 req-02a50b8c-f829-48a0-a53b-977b79a0dc88 service nova] Creating event network-changed:1b5eb467-65ff-42a9-ae4a-da9f4bbed5d1 for instance ebbb4a6b-6863-4efc-8e24-5073fcf14368 on hv-cinder-80374 Aug 07 04:53:57.270313 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-ca0a1466-f9cc-4080-a0d0-7ddff28fa178 req-02a50b8c-f829-48a0-a53b-977b79a0dc88 service nova] Acquired lock "compute-rpcapi-router" {{(pid=107486) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Aug 07 04:53:57.271969 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b0ebdbbb-f5e5-459f-851d-db6a56184c58 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:53:57.272732 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b0ebdbbb-f5e5-459f-851d-db6a56184c58 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:53:57.288109 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-22593c3e-6c6a-4b4c-9250-7e892e1a8193 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:53:57.292703 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-22593c3e-6c6a-4b4c-9250-7e892e1a8193 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:53:57.295034 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-22593c3e-6c6a-4b4c-9250-7e892e1a8193 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:53:57.297036 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-22593c3e-6c6a-4b4c-9250-7e892e1a8193 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:53:57.309693 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b0ebdbbb-f5e5-459f-851d-db6a56184c58 None None] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:53:57.310567 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b0ebdbbb-f5e5-459f-851d-db6a56184c58 None None] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.037s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:53:57.356771 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.compute.rpcapi [None req-b0ebdbbb-f5e5-459f-851d-db6a56184c58 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Aug 07 04:53:57.362200 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b0ebdbbb-f5e5-459f-851d-db6a56184c58 None None] Releasing lock "compute-rpcapi-router" {{(pid=107486) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Aug 07 04:53:57.393916 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-b0ebdbbb-f5e5-459f-851d-db6a56184c58 None None] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.522514 Aug 07 04:53:57.394543 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 19/37] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 04:53:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:53:57.401959 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-d40620c4-d113-45dd-bbc9-35324d234014 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:53:57.403167 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-d40620c4-d113-45dd-bbc9-35324d234014 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:53:57.492155 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-d40620c4-d113-45dd-bbc9-35324d234014 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:53:57.500473 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-d40620c4-d113-45dd-bbc9-35324d234014 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1222 microversion: 2.1 time: 0.104498 Aug 07 04:53:57.510206 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 20/38] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:53:57 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1222 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:53:57.647893 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-22593c3e-6c6a-4b4c-9250-7e892e1a8193 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:53:57.657858 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-22593c3e-6c6a-4b4c-9250-7e892e1a8193 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b" status: 200 len: 1318 microversion: 2.1 time: 0.405966 Aug 07 04:53:57.658731 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 19/39] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:53:57 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b => generated 1318 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:53:57.876464 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-8f92b865-3618-43af-b2b6-78ad64de8402 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:53:57.877155 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-8f92b865-3618-43af-b2b6-78ad64de8402 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] [instance: ebbb4a6b-6863-4efc-8e24-5073fcf14368] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:53:57.884458 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8f92b865-3618-43af-b2b6-78ad64de8402 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:53:57.885838 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8f92b865-3618-43af-b2b6-78ad64de8402 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:53:57.887687 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8f92b865-3618-43af-b2b6-78ad64de8402 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:53:57.889280 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8f92b865-3618-43af-b2b6-78ad64de8402 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:53:57.895110 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-66846a07-8d51-4f2c-8508-36cbc902cfe3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-704794848", "imageRef": "ddcf95b5-3ea4-4a61-8f54-4b2feadb8682", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fc7aefab-048b-463e-a51e-c06e7a8144a6"}], "security_groups": [{"name": "tempest-securitygroup--5535861"}], "key_name": "tempest-keypair-755006623", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:53:58.016303 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.network.neutron [None req-66846a07-8d51-4f2c-8508-36cbc902cfe3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] validate_networks() for [('fc7aefab-048b-463e-a51e-c06e7a8144a6', None, None, None)] {{(pid=107485) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 07 04:53:58.065650 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-8f92b865-3618-43af-b2b6-78ad64de8402 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa958efbec43feaf2a6341496d7eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbad771114b14d1c813e85f39291b826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:53:58.074293 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-8f92b865-3618-43af-b2b6-78ad64de8402 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] 10.222.0.35 "GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368" status: 200 len: 1315 microversion: 2.1 time: 0.202759 Aug 07 04:53:58.074868 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 21/40] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:53:57 2021] GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:53:58.383865 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.virt.hardware [None req-66846a07-8d51-4f2c-8508-36cbc902cfe3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Flavor limits 0:0:0 {{(pid=107485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 04:53:58.384348 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.virt.hardware [None req-66846a07-8d51-4f2c-8508-36cbc902cfe3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Image limits 0:0:0 {{(pid=107485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 04:53:58.384890 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.virt.hardware [None req-66846a07-8d51-4f2c-8508-36cbc902cfe3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Flavor pref 0:0:0 {{(pid=107485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 04:53:58.385424 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.virt.hardware [None req-66846a07-8d51-4f2c-8508-36cbc902cfe3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Image pref 0:0:0 {{(pid=107485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 04:53:58.385944 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.virt.hardware [None req-66846a07-8d51-4f2c-8508-36cbc902cfe3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 04:53:58.394896 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-66846a07-8d51-4f2c-8508-36cbc902cfe3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:53:58.395404 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-66846a07-8d51-4f2c-8508-36cbc902cfe3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:53:58.396204 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-66846a07-8d51-4f2c-8508-36cbc902cfe3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:53:58.396639 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-66846a07-8d51-4f2c-8508-36cbc902cfe3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:53:58.414149 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.quota [None req-66846a07-8d51-4f2c-8508-36cbc902cfe3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Getting quotas for project 6c23fa4998bf4a8cb6fa05e019c813bd. Resources: {'ram', 'cores', 'instances'} {{(pid=107485) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 07 04:53:58.419208 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.quota [None req-66846a07-8d51-4f2c-8508-36cbc902cfe3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Getting quotas for user 9f3bcbbebe354fe9a2a9ae24d7b792d1 and project 6c23fa4998bf4a8cb6fa05e019c813bd. Resources: {'ram', 'cores', 'instances'} {{(pid=107485) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 07 04:53:58.429872 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-66846a07-8d51-4f2c-8508-36cbc902cfe3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Going to run 1 instances... {{(pid=107485) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 07 04:53:58.432380 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-66846a07-8d51-4f2c-8508-36cbc902cfe3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ddcf95b5-3ea4-4a61-8f54-4b2feadb8682',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107485) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 07 04:53:58.489144 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-66846a07-8d51-4f2c-8508-36cbc902cfe3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 0.598043 Aug 07 04:53:58.489898 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 20/41] 10.222.0.35 () {62 vars in 1188 bytes} [Sat Aug 7 04:53:57 2021] POST /compute/v2.1/servers => generated 399 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 07 04:53:58.500537 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-c797a321-a235-4334-abbe-8ceaffd8504f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:53:58.501179 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-c797a321-a235-4334-abbe-8ceaffd8504f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:53:58.519450 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-c8e9e029-32b2-4c66-8648-40142e4d06e6 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:53:58.520131 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-c8e9e029-32b2-4c66-8648-40142e4d06e6 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:53:58.532989 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c8e9e029-32b2-4c66-8648-40142e4d06e6 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:53:58.533556 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c8e9e029-32b2-4c66-8648-40142e4d06e6 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:53:58.534236 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c8e9e029-32b2-4c66-8648-40142e4d06e6 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:53:58.534678 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c8e9e029-32b2-4c66-8648-40142e4d06e6 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:53:58.567811 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-c797a321-a235-4334-abbe-8ceaffd8504f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:53:58.585405 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-c797a321-a235-4334-abbe-8ceaffd8504f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:53:58.587560 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-c797a321-a235-4334-abbe-8ceaffd8504f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:53:58.589349 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-c797a321-a235-4334-abbe-8ceaffd8504f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1280 microversion: 2.20 time: 0.092786 Aug 07 04:53:58.601204 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 22/42] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:53:58 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1280 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:53:58.607528 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-c8e9e029-32b2-4c66-8648-40142e4d06e6 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:53:58.615070 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-c8e9e029-32b2-4c66-8648-40142e4d06e6 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1226 microversion: 2.1 time: 0.100634 Aug 07 04:53:58.616034 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 21/43] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:53:58 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:53:58.675296 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-76097f54-25e4-49bc-ad60-e0a71d78d9b0 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:53:58.676225 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-76097f54-25e4-49bc-ad60-e0a71d78d9b0 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:53:58.685330 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-76097f54-25e4-49bc-ad60-e0a71d78d9b0 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:53:58.685781 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-76097f54-25e4-49bc-ad60-e0a71d78d9b0 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:53:58.686574 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-76097f54-25e4-49bc-ad60-e0a71d78d9b0 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:53:58.687014 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-76097f54-25e4-49bc-ad60-e0a71d78d9b0 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:53:58.820689 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-76097f54-25e4-49bc-ad60-e0a71d78d9b0 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:53:58.828159 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-76097f54-25e4-49bc-ad60-e0a71d78d9b0 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b" status: 200 len: 1318 microversion: 2.1 time: 0.156929 Aug 07 04:53:58.829022 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 23/44] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:53:58 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:53:59.091699 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-b4d150d7-0b33-4040-bec8-f05e6c938b9f tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:53:59.092361 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-b4d150d7-0b33-4040-bec8-f05e6c938b9f tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] [instance: ebbb4a6b-6863-4efc-8e24-5073fcf14368] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:53:59.098104 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b4d150d7-0b33-4040-bec8-f05e6c938b9f tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:53:59.098555 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b4d150d7-0b33-4040-bec8-f05e6c938b9f tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:53:59.099350 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b4d150d7-0b33-4040-bec8-f05e6c938b9f tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:53:59.099783 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b4d150d7-0b33-4040-bec8-f05e6c938b9f tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:53:59.218810 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-b4d150d7-0b33-4040-bec8-f05e6c938b9f tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa958efbec43feaf2a6341496d7eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbad771114b14d1c813e85f39291b826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:53:59.226003 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-b4d150d7-0b33-4040-bec8-f05e6c938b9f tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] 10.222.0.35 "GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368" status: 200 len: 1315 microversion: 2.1 time: 0.139070 Aug 07 04:53:59.226566 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 22/45] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:53:59 2021] GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368 => generated 1315 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:53:59.409940 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [req-299a63c1-f346-49f1-8564-e9c460476660 req-05a3ce46-82ae-4e46-87ef-0c0c856bab0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bba229d-781a-409e-8079-6c9764d8124b", "tag": "6da7b6cb-d1db-46c0-b902-4f615a911fcf"}]} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:53:59.411496 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 04:53:59.411496 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: warnings.warn(msg) Aug 07 04:53:59.418629 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-299a63c1-f346-49f1-8564-e9c460476660 req-05a3ce46-82ae-4e46-87ef-0c0c856bab0d service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:53:59.419068 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-299a63c1-f346-49f1-8564-e9c460476660 req-05a3ce46-82ae-4e46-87ef-0c0c856bab0d service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:53:59.430610 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.compute.server_external_events [req-299a63c1-f346-49f1-8564-e9c460476660 req-05a3ce46-82ae-4e46-87ef-0c0c856bab0d service nova] Creating event network-changed:6da7b6cb-d1db-46c0-b902-4f615a911fcf for instance 3bba229d-781a-409e-8079-6c9764d8124b on hv-cinder-80374 Aug 07 04:53:59.435406 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [req-299a63c1-f346-49f1-8564-e9c460476660 req-05a3ce46-82ae-4e46-87ef-0c0c856bab0d service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029065 Aug 07 04:53:59.435976 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 24/46] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 04:53:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:53:59.609284 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-36404e53-0532-4434-9930-ac09a2b37556 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:53:59.609912 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-36404e53-0532-4434-9930-ac09a2b37556 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:53:59.618908 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-36404e53-0532-4434-9930-ac09a2b37556 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:53:59.619351 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-36404e53-0532-4434-9930-ac09a2b37556 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:53:59.620372 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-36404e53-0532-4434-9930-ac09a2b37556 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:53:59.620668 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-36404e53-0532-4434-9930-ac09a2b37556 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:53:59.631828 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-fe6706c3-c788-4ed8-9bcd-7eef10dd5cf2 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:53:59.632537 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-fe6706c3-c788-4ed8-9bcd-7eef10dd5cf2 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:53:59.638890 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-fe6706c3-c788-4ed8-9bcd-7eef10dd5cf2 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:53:59.639408 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-fe6706c3-c788-4ed8-9bcd-7eef10dd5cf2 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:53:59.640302 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-fe6706c3-c788-4ed8-9bcd-7eef10dd5cf2 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:53:59.640934 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-fe6706c3-c788-4ed8-9bcd-7eef10dd5cf2 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:53:59.683436 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-36404e53-0532-4434-9930-ac09a2b37556 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:53:59.691193 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-36404e53-0532-4434-9930-ac09a2b37556 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:53:59.692689 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-36404e53-0532-4434-9930-ac09a2b37556 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:53:59.693798 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-36404e53-0532-4434-9930-ac09a2b37556 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1284 microversion: 2.20 time: 0.088948 Aug 07 04:53:59.694347 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 23/47] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:53:59 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:53:59.701398 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-fe6706c3-c788-4ed8-9bcd-7eef10dd5cf2 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:53:59.708705 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-fe6706c3-c788-4ed8-9bcd-7eef10dd5cf2 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1226 microversion: 2.1 time: 0.081048 Aug 07 04:53:59.709363 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 25/48] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:53:59 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:53:59.846119 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-bff2f4ca-cb14-43e6-ad69-b197c0bbd869 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:53:59.846758 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-bff2f4ca-cb14-43e6-ad69-b197c0bbd869 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:53:59.852682 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-bff2f4ca-cb14-43e6-ad69-b197c0bbd869 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:53:59.853158 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-bff2f4ca-cb14-43e6-ad69-b197c0bbd869 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:53:59.853916 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-bff2f4ca-cb14-43e6-ad69-b197c0bbd869 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:53:59.855053 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-bff2f4ca-cb14-43e6-ad69-b197c0bbd869 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:53:59.971713 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-bff2f4ca-cb14-43e6-ad69-b197c0bbd869 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:53:59.978918 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-bff2f4ca-cb14-43e6-ad69-b197c0bbd869 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b" status: 200 len: 1318 microversion: 2.1 time: 0.136412 Aug 07 04:53:59.980027 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 24/49] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:53:59 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b => generated 1318 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:00.242488 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-9c8681e7-ed82-45a4-b116-3de1dd46afe6 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:00.243024 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-9c8681e7-ed82-45a4-b116-3de1dd46afe6 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] [instance: ebbb4a6b-6863-4efc-8e24-5073fcf14368] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:00.249545 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9c8681e7-ed82-45a4-b116-3de1dd46afe6 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:00.249988 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9c8681e7-ed82-45a4-b116-3de1dd46afe6 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:00.250776 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9c8681e7-ed82-45a4-b116-3de1dd46afe6 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:00.251207 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9c8681e7-ed82-45a4-b116-3de1dd46afe6 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:00.372974 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-9c8681e7-ed82-45a4-b116-3de1dd46afe6 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa958efbec43feaf2a6341496d7eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbad771114b14d1c813e85f39291b826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:00.380315 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-9c8681e7-ed82-45a4-b116-3de1dd46afe6 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] 10.222.0.35 "GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368" status: 200 len: 1315 microversion: 2.1 time: 0.141526 Aug 07 04:54:00.380898 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 26/50] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:00 2021] GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368 => generated 1315 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:00.711662 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-118fd398-21b7-45a8-b5db-e9d8f53af536 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:00.712328 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-118fd398-21b7-45a8-b5db-e9d8f53af536 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:00.718791 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-118fd398-21b7-45a8-b5db-e9d8f53af536 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:00.719223 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-118fd398-21b7-45a8-b5db-e9d8f53af536 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:00.720022 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-118fd398-21b7-45a8-b5db-e9d8f53af536 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:00.720451 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-118fd398-21b7-45a8-b5db-e9d8f53af536 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:00.726188 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-49683ead-e5b8-4ade-838b-2a4c4235b7b5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:00.726839 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-49683ead-e5b8-4ade-838b-2a4c4235b7b5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:00.733449 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-49683ead-e5b8-4ade-838b-2a4c4235b7b5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:00.733896 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-49683ead-e5b8-4ade-838b-2a4c4235b7b5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:00.734658 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-49683ead-e5b8-4ade-838b-2a4c4235b7b5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:00.735095 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-49683ead-e5b8-4ade-838b-2a4c4235b7b5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:00.779391 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-118fd398-21b7-45a8-b5db-e9d8f53af536 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:00.787007 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-118fd398-21b7-45a8-b5db-e9d8f53af536 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:00.788541 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-118fd398-21b7-45a8-b5db-e9d8f53af536 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:00.789696 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-118fd398-21b7-45a8-b5db-e9d8f53af536 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1284 microversion: 2.20 time: 0.081786 Aug 07 04:54:00.790244 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 25/51] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:54:00 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1284 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:54:00.794461 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-49683ead-e5b8-4ade-838b-2a4c4235b7b5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:00.801665 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-49683ead-e5b8-4ade-838b-2a4c4235b7b5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1226 microversion: 2.1 time: 0.079404 Aug 07 04:54:00.802205 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 27/52] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:00 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:54:00.995738 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-9480c891-bd00-468a-95ce-a6f87a485d49 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:00.996754 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-9480c891-bd00-468a-95ce-a6f87a485d49 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:01.002604 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9480c891-bd00-468a-95ce-a6f87a485d49 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:01.003059 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9480c891-bd00-468a-95ce-a6f87a485d49 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:01.004312 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9480c891-bd00-468a-95ce-a6f87a485d49 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:01.004760 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9480c891-bd00-468a-95ce-a6f87a485d49 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:01.141734 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-9480c891-bd00-468a-95ce-a6f87a485d49 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:01.149070 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-9480c891-bd00-468a-95ce-a6f87a485d49 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b" status: 200 len: 1318 microversion: 2.1 time: 0.156992 Aug 07 04:54:01.149621 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 26/53] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:00 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:01.397475 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-97dc7ad1-1e35-4955-a9d3-76ff16e2dc56 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:01.398088 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-97dc7ad1-1e35-4955-a9d3-76ff16e2dc56 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] [instance: ebbb4a6b-6863-4efc-8e24-5073fcf14368] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:01.404500 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-97dc7ad1-1e35-4955-a9d3-76ff16e2dc56 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:01.404982 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-97dc7ad1-1e35-4955-a9d3-76ff16e2dc56 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:01.405846 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-97dc7ad1-1e35-4955-a9d3-76ff16e2dc56 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:01.406323 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-97dc7ad1-1e35-4955-a9d3-76ff16e2dc56 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:01.524652 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-97dc7ad1-1e35-4955-a9d3-76ff16e2dc56 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa958efbec43feaf2a6341496d7eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbad771114b14d1c813e85f39291b826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:01.532597 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-97dc7ad1-1e35-4955-a9d3-76ff16e2dc56 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] 10.222.0.35 "GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368" status: 200 len: 1315 microversion: 2.1 time: 0.138744 Aug 07 04:54:01.533192 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 28/54] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:01 2021] GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368 => generated 1315 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:01.807225 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-e063c613-f4b0-4e6f-bcdd-62912c1acc4e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:01.807885 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-e063c613-f4b0-4e6f-bcdd-62912c1acc4e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:01.814566 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e063c613-f4b0-4e6f-bcdd-62912c1acc4e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:01.815014 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e063c613-f4b0-4e6f-bcdd-62912c1acc4e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:01.815807 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e063c613-f4b0-4e6f-bcdd-62912c1acc4e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:01.816240 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e063c613-f4b0-4e6f-bcdd-62912c1acc4e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:01.818593 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-1800d36a-d189-412b-8779-e0b9d458dc92 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:01.819211 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-1800d36a-d189-412b-8779-e0b9d458dc92 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:01.825618 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1800d36a-d189-412b-8779-e0b9d458dc92 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:01.826071 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1800d36a-d189-412b-8779-e0b9d458dc92 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:01.826846 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1800d36a-d189-412b-8779-e0b9d458dc92 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:01.827289 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1800d36a-d189-412b-8779-e0b9d458dc92 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:01.879392 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-e063c613-f4b0-4e6f-bcdd-62912c1acc4e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:01.888095 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-e063c613-f4b0-4e6f-bcdd-62912c1acc4e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:01.889717 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-e063c613-f4b0-4e6f-bcdd-62912c1acc4e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:01.890274 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-1800d36a-d189-412b-8779-e0b9d458dc92 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:01.890934 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-e063c613-f4b0-4e6f-bcdd-62912c1acc4e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1284 microversion: 2.20 time: 0.087442 Aug 07 04:54:01.891559 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 27/55] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:54:01 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:54:01.897561 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-1800d36a-d189-412b-8779-e0b9d458dc92 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1226 microversion: 2.1 time: 0.082549 Aug 07 04:54:01.898282 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 29/56] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:01 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:54:02.165595 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-2e13b83c-2bfc-405e-9926-6e7ca9262edb tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:02.166396 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-2e13b83c-2bfc-405e-9926-6e7ca9262edb tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:02.172502 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2e13b83c-2bfc-405e-9926-6e7ca9262edb tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:02.172969 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2e13b83c-2bfc-405e-9926-6e7ca9262edb tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:02.173696 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2e13b83c-2bfc-405e-9926-6e7ca9262edb tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:02.174140 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2e13b83c-2bfc-405e-9926-6e7ca9262edb tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:02.294372 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-2e13b83c-2bfc-405e-9926-6e7ca9262edb tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:02.301735 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-2e13b83c-2bfc-405e-9926-6e7ca9262edb tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b" status: 200 len: 1318 microversion: 2.1 time: 0.139857 Aug 07 04:54:02.302291 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 28/57] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:02 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b => generated 1318 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:02.550514 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-67896455-d88e-45e9-a9b6-7ae3223163c7 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:02.551142 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-67896455-d88e-45e9-a9b6-7ae3223163c7 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] [instance: ebbb4a6b-6863-4efc-8e24-5073fcf14368] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:02.557367 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-67896455-d88e-45e9-a9b6-7ae3223163c7 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:02.557817 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-67896455-d88e-45e9-a9b6-7ae3223163c7 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:02.558643 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-67896455-d88e-45e9-a9b6-7ae3223163c7 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:02.559734 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-67896455-d88e-45e9-a9b6-7ae3223163c7 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:02.701052 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-67896455-d88e-45e9-a9b6-7ae3223163c7 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa958efbec43feaf2a6341496d7eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbad771114b14d1c813e85f39291b826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:02.705271 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-67896455-d88e-45e9-a9b6-7ae3223163c7 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] 10.222.0.35 "GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368" status: 200 len: 1315 microversion: 2.1 time: 0.158421 Aug 07 04:54:02.705907 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 30/58] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:02 2021] GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:02.909142 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-0486cdbe-bd8f-446e-9a58-b2c1a589ec68 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:02.910445 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-0486cdbe-bd8f-446e-9a58-b2c1a589ec68 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:02.914349 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-a75cfa9f-a533-4057-b1a0-0ca3e4a6cb03 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:02.915542 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-a75cfa9f-a533-4057-b1a0-0ca3e4a6cb03 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:02.916426 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0486cdbe-bd8f-446e-9a58-b2c1a589ec68 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:02.916912 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0486cdbe-bd8f-446e-9a58-b2c1a589ec68 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:02.917996 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0486cdbe-bd8f-446e-9a58-b2c1a589ec68 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:02.918588 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0486cdbe-bd8f-446e-9a58-b2c1a589ec68 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:02.922157 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a75cfa9f-a533-4057-b1a0-0ca3e4a6cb03 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:02.922680 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a75cfa9f-a533-4057-b1a0-0ca3e4a6cb03 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:02.923530 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a75cfa9f-a533-4057-b1a0-0ca3e4a6cb03 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:02.924123 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a75cfa9f-a533-4057-b1a0-0ca3e4a6cb03 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:02.980581 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-0486cdbe-bd8f-446e-9a58-b2c1a589ec68 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:02.988885 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-0486cdbe-bd8f-446e-9a58-b2c1a589ec68 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:02.990197 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-0486cdbe-bd8f-446e-9a58-b2c1a589ec68 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:02.990933 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-a75cfa9f-a533-4057-b1a0-0ca3e4a6cb03 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:02.991288 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-0486cdbe-bd8f-446e-9a58-b2c1a589ec68 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1284 microversion: 2.20 time: 0.085925 Aug 07 04:54:02.991839 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 29/59] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:54:02 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1284 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:54:02.998775 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-a75cfa9f-a533-4057-b1a0-0ca3e4a6cb03 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1226 microversion: 2.1 time: 0.088177 Aug 07 04:54:02.999333 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 31/60] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:02 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:03.318026 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-40d41778-1942-4bb5-96b6-6baeaf56da6b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:03.318647 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-40d41778-1942-4bb5-96b6-6baeaf56da6b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:03.325111 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-40d41778-1942-4bb5-96b6-6baeaf56da6b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:03.325512 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-40d41778-1942-4bb5-96b6-6baeaf56da6b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:03.326292 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-40d41778-1942-4bb5-96b6-6baeaf56da6b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:03.326743 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-40d41778-1942-4bb5-96b6-6baeaf56da6b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:03.452825 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-40d41778-1942-4bb5-96b6-6baeaf56da6b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:03.460956 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-40d41778-1942-4bb5-96b6-6baeaf56da6b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b" status: 200 len: 1318 microversion: 2.1 time: 0.146479 Aug 07 04:54:03.471454 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 30/61] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:03 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:03.722051 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-b8c4a8e1-e06e-4f58-8a02-0fdeceb760c4 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:03.722662 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-b8c4a8e1-e06e-4f58-8a02-0fdeceb760c4 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] [instance: ebbb4a6b-6863-4efc-8e24-5073fcf14368] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:03.735144 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b8c4a8e1-e06e-4f58-8a02-0fdeceb760c4 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:03.735992 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b8c4a8e1-e06e-4f58-8a02-0fdeceb760c4 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:03.739903 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b8c4a8e1-e06e-4f58-8a02-0fdeceb760c4 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:03.740447 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b8c4a8e1-e06e-4f58-8a02-0fdeceb760c4 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:03.870297 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-b8c4a8e1-e06e-4f58-8a02-0fdeceb760c4 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa958efbec43feaf2a6341496d7eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbad771114b14d1c813e85f39291b826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:03.878948 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-b8c4a8e1-e06e-4f58-8a02-0fdeceb760c4 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] 10.222.0.35 "GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368" status: 200 len: 1315 microversion: 2.1 time: 0.160413 Aug 07 04:54:03.879524 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 32/62] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:03 2021] GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:04.009442 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-63a6dbf8-9634-4c64-bc92-2c042f09b257 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:04.010125 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-63a6dbf8-9634-4c64-bc92-2c042f09b257 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:04.015910 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-428803c0-b6c4-4bed-ae0f-ad3a00c8d1f1 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:04.016650 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-428803c0-b6c4-4bed-ae0f-ad3a00c8d1f1 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:04.016751 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-63a6dbf8-9634-4c64-bc92-2c042f09b257 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:04.017153 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-63a6dbf8-9634-4c64-bc92-2c042f09b257 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:04.017915 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-63a6dbf8-9634-4c64-bc92-2c042f09b257 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:04.019377 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-63a6dbf8-9634-4c64-bc92-2c042f09b257 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:04.026013 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-428803c0-b6c4-4bed-ae0f-ad3a00c8d1f1 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:04.026307 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-428803c0-b6c4-4bed-ae0f-ad3a00c8d1f1 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:04.027157 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-428803c0-b6c4-4bed-ae0f-ad3a00c8d1f1 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:04.027901 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-428803c0-b6c4-4bed-ae0f-ad3a00c8d1f1 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:04.086966 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-63a6dbf8-9634-4c64-bc92-2c042f09b257 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:04.094590 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-428803c0-b6c4-4bed-ae0f-ad3a00c8d1f1 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:04.095934 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-63a6dbf8-9634-4c64-bc92-2c042f09b257 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:04.097635 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-63a6dbf8-9634-4c64-bc92-2c042f09b257 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:04.098952 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-63a6dbf8-9634-4c64-bc92-2c042f09b257 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1284 microversion: 2.20 time: 0.093171 Aug 07 04:54:04.099630 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 31/63] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:54:04 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:54:04.102352 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-428803c0-b6c4-4bed-ae0f-ad3a00c8d1f1 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1226 microversion: 2.1 time: 0.090803 Aug 07 04:54:04.102906 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 33/64] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:04 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:04.478763 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-1b2f7cd9-57c6-4e95-a19e-f72c3e486038 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:04.479382 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-1b2f7cd9-57c6-4e95-a19e-f72c3e486038 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:04.486232 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1b2f7cd9-57c6-4e95-a19e-f72c3e486038 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:04.486684 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1b2f7cd9-57c6-4e95-a19e-f72c3e486038 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:04.487473 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1b2f7cd9-57c6-4e95-a19e-f72c3e486038 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:04.487912 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1b2f7cd9-57c6-4e95-a19e-f72c3e486038 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:04.610053 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-1b2f7cd9-57c6-4e95-a19e-f72c3e486038 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:04.617538 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-1b2f7cd9-57c6-4e95-a19e-f72c3e486038 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b" status: 200 len: 1318 microversion: 2.1 time: 0.142486 Aug 07 04:54:04.618340 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 32/65] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:04 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b => generated 1318 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:04.898304 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-36eba3a1-8d7e-4568-833c-9d7cf68fbb69 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:04.899029 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-36eba3a1-8d7e-4568-833c-9d7cf68fbb69 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] [instance: ebbb4a6b-6863-4efc-8e24-5073fcf14368] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:04.905712 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-36eba3a1-8d7e-4568-833c-9d7cf68fbb69 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:04.906160 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-36eba3a1-8d7e-4568-833c-9d7cf68fbb69 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:04.907020 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-36eba3a1-8d7e-4568-833c-9d7cf68fbb69 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:04.907458 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-36eba3a1-8d7e-4568-833c-9d7cf68fbb69 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:05.026176 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-36eba3a1-8d7e-4568-833c-9d7cf68fbb69 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa958efbec43feaf2a6341496d7eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbad771114b14d1c813e85f39291b826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:05.033646 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-36eba3a1-8d7e-4568-833c-9d7cf68fbb69 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] 10.222.0.35 "GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368" status: 200 len: 1315 microversion: 2.1 time: 0.141871 Aug 07 04:54:05.034194 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 34/66] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:04 2021] GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368 => generated 1315 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:05.116027 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-bd18a98a-618e-46bb-be8c-add8bfdf416c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:05.116656 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-bd18a98a-618e-46bb-be8c-add8bfdf416c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:05.120248 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-078be882-c99b-4c21-822f-5aded28ca4b0 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:05.121106 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-078be882-c99b-4c21-822f-5aded28ca4b0 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:05.123331 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-bd18a98a-618e-46bb-be8c-add8bfdf416c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:05.123635 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-bd18a98a-618e-46bb-be8c-add8bfdf416c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:05.124715 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-bd18a98a-618e-46bb-be8c-add8bfdf416c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:05.124845 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-bd18a98a-618e-46bb-be8c-add8bfdf416c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:05.128088 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-078be882-c99b-4c21-822f-5aded28ca4b0 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:05.128601 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-078be882-c99b-4c21-822f-5aded28ca4b0 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:05.129557 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-078be882-c99b-4c21-822f-5aded28ca4b0 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:05.130011 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-078be882-c99b-4c21-822f-5aded28ca4b0 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:05.206582 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-078be882-c99b-4c21-822f-5aded28ca4b0 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:05.213866 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-078be882-c99b-4c21-822f-5aded28ca4b0 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1226 microversion: 2.1 time: 0.097418 Aug 07 04:54:05.214428 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 35/67] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:05 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:54:05.216825 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-bd18a98a-618e-46bb-be8c-add8bfdf416c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:05.224540 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-bd18a98a-618e-46bb-be8c-add8bfdf416c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:05.226051 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-bd18a98a-618e-46bb-be8c-add8bfdf416c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:05.227119 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-bd18a98a-618e-46bb-be8c-add8bfdf416c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1284 microversion: 2.20 time: 0.115013 Aug 07 04:54:05.227651 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 33/68] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:54:05 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1284 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:54:05.634696 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-fce7c5bb-7f91-4e76-af73-1f79c5b52f98 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:05.635326 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-fce7c5bb-7f91-4e76-af73-1f79c5b52f98 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:05.641904 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-fce7c5bb-7f91-4e76-af73-1f79c5b52f98 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:05.642353 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-fce7c5bb-7f91-4e76-af73-1f79c5b52f98 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:05.643112 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-fce7c5bb-7f91-4e76-af73-1f79c5b52f98 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:05.643541 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-fce7c5bb-7f91-4e76-af73-1f79c5b52f98 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:05.777639 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-fce7c5bb-7f91-4e76-af73-1f79c5b52f98 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:05.785474 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-fce7c5bb-7f91-4e76-af73-1f79c5b52f98 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b" status: 200 len: 1318 microversion: 2.1 time: 0.154359 Aug 07 04:54:05.786234 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 36/69] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:05 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:06.050059 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-2440193f-6381-4a98-8921-74030087ce6e tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:06.050597 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-2440193f-6381-4a98-8921-74030087ce6e tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] [instance: ebbb4a6b-6863-4efc-8e24-5073fcf14368] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:06.056449 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2440193f-6381-4a98-8921-74030087ce6e tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:06.056925 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2440193f-6381-4a98-8921-74030087ce6e tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:06.057688 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2440193f-6381-4a98-8921-74030087ce6e tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:06.058121 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2440193f-6381-4a98-8921-74030087ce6e tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:06.181371 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-2440193f-6381-4a98-8921-74030087ce6e tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa958efbec43feaf2a6341496d7eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbad771114b14d1c813e85f39291b826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:06.190082 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-2440193f-6381-4a98-8921-74030087ce6e tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] 10.222.0.35 "GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368" status: 200 len: 1315 microversion: 2.1 time: 0.143664 Aug 07 04:54:06.190654 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 34/70] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:06 2021] GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368 => generated 1315 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:06.232302 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-0003523e-9a7e-403f-ac74-4e5cc48acb18 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:06.232952 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-0003523e-9a7e-403f-ac74-4e5cc48acb18 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:06.238851 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0003523e-9a7e-403f-ac74-4e5cc48acb18 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:06.239304 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0003523e-9a7e-403f-ac74-4e5cc48acb18 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:06.240132 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0003523e-9a7e-403f-ac74-4e5cc48acb18 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:06.240568 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0003523e-9a7e-403f-ac74-4e5cc48acb18 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:06.244343 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-7215b44e-88f4-4c4c-8634-732908dce288 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:06.244989 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-7215b44e-88f4-4c4c-8634-732908dce288 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:06.250706 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7215b44e-88f4-4c4c-8634-732908dce288 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:06.251145 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7215b44e-88f4-4c4c-8634-732908dce288 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:06.251897 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7215b44e-88f4-4c4c-8634-732908dce288 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:06.252324 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7215b44e-88f4-4c4c-8634-732908dce288 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:06.301131 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-0003523e-9a7e-403f-ac74-4e5cc48acb18 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:06.308657 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-0003523e-9a7e-403f-ac74-4e5cc48acb18 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1226 microversion: 2.1 time: 0.081065 Aug 07 04:54:06.309905 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 37/71] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:06 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:06.313453 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-7215b44e-88f4-4c4c-8634-732908dce288 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:06.321009 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-7215b44e-88f4-4c4c-8634-732908dce288 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:06.322491 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-7215b44e-88f4-4c4c-8634-732908dce288 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:06.323546 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-7215b44e-88f4-4c4c-8634-732908dce288 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1284 microversion: 2.20 time: 0.082882 Aug 07 04:54:06.324096 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 35/72] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:54:06 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1284 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 04:54:06.801134 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-9cd33881-1b85-44a8-b54e-841828645211 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:06.801739 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-9cd33881-1b85-44a8-b54e-841828645211 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:06.807884 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9cd33881-1b85-44a8-b54e-841828645211 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:06.808336 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9cd33881-1b85-44a8-b54e-841828645211 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:06.809233 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9cd33881-1b85-44a8-b54e-841828645211 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:06.809662 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9cd33881-1b85-44a8-b54e-841828645211 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:06.934377 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-9cd33881-1b85-44a8-b54e-841828645211 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:06.941509 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-9cd33881-1b85-44a8-b54e-841828645211 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b" status: 200 len: 1318 microversion: 2.1 time: 0.143995 Aug 07 04:54:06.942061 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 38/73] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:06 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b => generated 1318 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:07.206817 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-275b8f39-0d2a-4c89-af4b-2f755a631f4e tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:07.207357 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-275b8f39-0d2a-4c89-af4b-2f755a631f4e tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] [instance: ebbb4a6b-6863-4efc-8e24-5073fcf14368] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:07.213156 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-275b8f39-0d2a-4c89-af4b-2f755a631f4e tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:07.213600 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-275b8f39-0d2a-4c89-af4b-2f755a631f4e tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:07.214356 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-275b8f39-0d2a-4c89-af4b-2f755a631f4e tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:07.214847 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-275b8f39-0d2a-4c89-af4b-2f755a631f4e tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:07.326785 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-54af8fb7-17f4-48a8-9b05-99b745c0c785 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:07.327375 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-54af8fb7-17f4-48a8-9b05-99b745c0c785 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:07.333295 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-54af8fb7-17f4-48a8-9b05-99b745c0c785 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:07.333666 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-275b8f39-0d2a-4c89-af4b-2f755a631f4e tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa958efbec43feaf2a6341496d7eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbad771114b14d1c813e85f39291b826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:07.333797 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-54af8fb7-17f4-48a8-9b05-99b745c0c785 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:07.334494 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-54af8fb7-17f4-48a8-9b05-99b745c0c785 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:07.334924 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-54af8fb7-17f4-48a8-9b05-99b745c0c785 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:07.341104 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-275b8f39-0d2a-4c89-af4b-2f755a631f4e tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] 10.222.0.35 "GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368" status: 200 len: 1315 microversion: 2.1 time: 0.137734 Aug 07 04:54:07.341671 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 36/74] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:07 2021] GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368 => generated 1315 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:07.345913 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-cc172419-b23a-430f-b16d-300e85f13770 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:07.346519 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-cc172419-b23a-430f-b16d-300e85f13770 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:07.352141 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-cc172419-b23a-430f-b16d-300e85f13770 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:07.352589 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-cc172419-b23a-430f-b16d-300e85f13770 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:07.353395 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-cc172419-b23a-430f-b16d-300e85f13770 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:07.353833 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-cc172419-b23a-430f-b16d-300e85f13770 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:07.406265 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-54af8fb7-17f4-48a8-9b05-99b745c0c785 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:07.414939 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-54af8fb7-17f4-48a8-9b05-99b745c0c785 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1226 microversion: 2.1 time: 0.092860 Aug 07 04:54:07.415656 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 39/75] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:07 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:54:07.417227 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-cc172419-b23a-430f-b16d-300e85f13770 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:07.425428 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-cc172419-b23a-430f-b16d-300e85f13770 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:07.426908 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-cc172419-b23a-430f-b16d-300e85f13770 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:07.427968 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-cc172419-b23a-430f-b16d-300e85f13770 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1284 microversion: 2.20 time: 0.085397 Aug 07 04:54:07.428690 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 37/76] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:54:07 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1284 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:54:07.958218 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-162ccbd6-d84f-4953-b3cb-f1c893141cde tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:07.958822 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-162ccbd6-d84f-4953-b3cb-f1c893141cde tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:07.965281 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-162ccbd6-d84f-4953-b3cb-f1c893141cde tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:07.966061 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-162ccbd6-d84f-4953-b3cb-f1c893141cde tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:07.966810 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-162ccbd6-d84f-4953-b3cb-f1c893141cde tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:07.967236 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-162ccbd6-d84f-4953-b3cb-f1c893141cde tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:08.086719 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-162ccbd6-d84f-4953-b3cb-f1c893141cde tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:08.094815 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-162ccbd6-d84f-4953-b3cb-f1c893141cde tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b" status: 200 len: 1318 microversion: 2.1 time: 0.140317 Aug 07 04:54:08.095364 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 40/77] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:07 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b => generated 1318 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:08.357382 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-eadaefb2-a20a-4e57-8596-28ef8fe57f1a tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:08.357947 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-eadaefb2-a20a-4e57-8596-28ef8fe57f1a tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] [instance: ebbb4a6b-6863-4efc-8e24-5073fcf14368] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:08.363856 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-eadaefb2-a20a-4e57-8596-28ef8fe57f1a tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:08.364294 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-eadaefb2-a20a-4e57-8596-28ef8fe57f1a tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:08.365093 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-eadaefb2-a20a-4e57-8596-28ef8fe57f1a tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:08.365524 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-eadaefb2-a20a-4e57-8596-28ef8fe57f1a tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:08.432169 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-c5471f15-a59d-4535-a3f4-4ac51b49c326 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:08.432807 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-c5471f15-a59d-4535-a3f4-4ac51b49c326 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:08.439424 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c5471f15-a59d-4535-a3f4-4ac51b49c326 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:08.439867 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c5471f15-a59d-4535-a3f4-4ac51b49c326 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:08.440637 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c5471f15-a59d-4535-a3f4-4ac51b49c326 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:08.441094 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c5471f15-a59d-4535-a3f4-4ac51b49c326 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:08.490826 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-eadaefb2-a20a-4e57-8596-28ef8fe57f1a tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa958efbec43feaf2a6341496d7eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbad771114b14d1c813e85f39291b826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:08.498792 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-eadaefb2-a20a-4e57-8596-28ef8fe57f1a tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] 10.222.0.35 "GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368" status: 200 len: 1315 microversion: 2.1 time: 0.145586 Aug 07 04:54:08.502752 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-c5471f15-a59d-4535-a3f4-4ac51b49c326 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:08.507677 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 38/78] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:08 2021] GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:08.512852 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-fa945843-4722-4d99-80b9-23ad91a95649 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:08.513636 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-fa945843-4722-4d99-80b9-23ad91a95649 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:08.517957 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-c5471f15-a59d-4535-a3f4-4ac51b49c326 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1226 microversion: 2.1 time: 0.089401 Aug 07 04:54:08.518528 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 41/79] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:08 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:54:08.519558 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-fa945843-4722-4d99-80b9-23ad91a95649 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:08.520011 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-fa945843-4722-4d99-80b9-23ad91a95649 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:08.520840 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-fa945843-4722-4d99-80b9-23ad91a95649 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:08.521274 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-fa945843-4722-4d99-80b9-23ad91a95649 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:08.580427 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-fa945843-4722-4d99-80b9-23ad91a95649 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:08.588057 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-fa945843-4722-4d99-80b9-23ad91a95649 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:08.590118 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-fa945843-4722-4d99-80b9-23ad91a95649 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:08.591447 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-fa945843-4722-4d99-80b9-23ad91a95649 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1284 microversion: 2.20 time: 0.082665 Aug 07 04:54:08.591996 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 39/80] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:54:08 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1284 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:54:09.110645 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-802998ac-ba4d-4dde-af95-37d0269e6dc8 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:09.111528 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-802998ac-ba4d-4dde-af95-37d0269e6dc8 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:09.123743 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-802998ac-ba4d-4dde-af95-37d0269e6dc8 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:09.128455 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-802998ac-ba4d-4dde-af95-37d0269e6dc8 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:09.131696 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-802998ac-ba4d-4dde-af95-37d0269e6dc8 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:09.132228 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-802998ac-ba4d-4dde-af95-37d0269e6dc8 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:09.333812 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-802998ac-ba4d-4dde-af95-37d0269e6dc8 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:09.342376 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-802998ac-ba4d-4dde-af95-37d0269e6dc8 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b" status: 200 len: 1318 microversion: 2.1 time: 0.235252 Aug 07 04:54:09.342953 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 42/81] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:09 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:09.515958 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-442b0da7-a26d-41b6-a066-7b214a8d4581 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:09.516586 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-442b0da7-a26d-41b6-a066-7b214a8d4581 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] [instance: ebbb4a6b-6863-4efc-8e24-5073fcf14368] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:09.523103 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-442b0da7-a26d-41b6-a066-7b214a8d4581 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:09.523557 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-442b0da7-a26d-41b6-a066-7b214a8d4581 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:09.524347 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-442b0da7-a26d-41b6-a066-7b214a8d4581 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:09.524782 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-442b0da7-a26d-41b6-a066-7b214a8d4581 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:09.535444 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-f6761421-8310-4634-b054-c8bbd06c8cde tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:09.536339 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-f6761421-8310-4634-b054-c8bbd06c8cde tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:09.550199 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f6761421-8310-4634-b054-c8bbd06c8cde tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:09.550743 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f6761421-8310-4634-b054-c8bbd06c8cde tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:09.551757 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f6761421-8310-4634-b054-c8bbd06c8cde tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:09.552250 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f6761421-8310-4634-b054-c8bbd06c8cde tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:09.710810 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-f6761421-8310-4634-b054-c8bbd06c8cde tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:09.719395 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-f6761421-8310-4634-b054-c8bbd06c8cde tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1218 microversion: 2.1 time: 0.187522 Aug 07 04:54:09.731339 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 43/82] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:09 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1218 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:54:09.737723 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-7c14e37a-0a1d-4429-9416-0c7aeaef1948 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:09.738424 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-7c14e37a-0a1d-4429-9416-0c7aeaef1948 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:09.746811 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-7c14e37a-0a1d-4429-9416-0c7aeaef1948 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:09.747364 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-7c14e37a-0a1d-4429-9416-0c7aeaef1948 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:09.748201 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-7c14e37a-0a1d-4429-9416-0c7aeaef1948 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:09.749278 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-7c14e37a-0a1d-4429-9416-0c7aeaef1948 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:09.829453 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-7c14e37a-0a1d-4429-9416-0c7aeaef1948 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:09.838729 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-7c14e37a-0a1d-4429-9416-0c7aeaef1948 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:09.842629 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-7c14e37a-0a1d-4429-9416-0c7aeaef1948 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:09.843885 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-7c14e37a-0a1d-4429-9416-0c7aeaef1948 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1332 microversion: 2.20 time: 0.110546 Aug 07 04:54:09.848852 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 44/83] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:54:09 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1332 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:54:10.041370 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-442b0da7-a26d-41b6-a066-7b214a8d4581 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa958efbec43feaf2a6341496d7eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbad771114b14d1c813e85f39291b826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:10.050998 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-442b0da7-a26d-41b6-a066-7b214a8d4581 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] 10.222.0.35 "GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368" status: 200 len: 1315 microversion: 2.1 time: 0.539411 Aug 07 04:54:10.061870 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 40/84] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:09 2021] GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368 => generated 1315 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:10.360235 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-a8bea820-9130-4e0c-907c-4e3acbb25f31 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:10.361242 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-a8bea820-9130-4e0c-907c-4e3acbb25f31 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:10.369948 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a8bea820-9130-4e0c-907c-4e3acbb25f31 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:10.373037 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a8bea820-9130-4e0c-907c-4e3acbb25f31 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:10.374267 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a8bea820-9130-4e0c-907c-4e3acbb25f31 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:10.374975 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a8bea820-9130-4e0c-907c-4e3acbb25f31 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:10.737242 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-13df5bea-8eb4-4234-a106-17485f47a4a0 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:10.737971 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-13df5bea-8eb4-4234-a106-17485f47a4a0 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:10.738479 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-a8bea820-9130-4e0c-907c-4e3acbb25f31 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:10.745123 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-13df5bea-8eb4-4234-a106-17485f47a4a0 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:10.746374 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-a8bea820-9130-4e0c-907c-4e3acbb25f31 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b" status: 200 len: 1318 microversion: 2.1 time: 0.390523 Aug 07 04:54:10.746609 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-13df5bea-8eb4-4234-a106-17485f47a4a0 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:10.748307 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-13df5bea-8eb4-4234-a106-17485f47a4a0 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:10.748751 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-13df5bea-8eb4-4234-a106-17485f47a4a0 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:10.754182 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 45/85] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:10 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b => generated 1318 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:10.828944 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-13df5bea-8eb4-4234-a106-17485f47a4a0 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:10.837557 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-13df5bea-8eb4-4234-a106-17485f47a4a0 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1274 microversion: 2.1 time: 0.104397 Aug 07 04:54:10.838797 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 41/86] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:10 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1274 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:10.862868 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-0048950c-b8c6-44e1-811c-ec3b999e2de8 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:10.863350 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-0048950c-b8c6-44e1-811c-ec3b999e2de8 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:10.870014 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0048950c-b8c6-44e1-811c-ec3b999e2de8 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:10.870674 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0048950c-b8c6-44e1-811c-ec3b999e2de8 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:10.872268 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0048950c-b8c6-44e1-811c-ec3b999e2de8 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:10.873033 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0048950c-b8c6-44e1-811c-ec3b999e2de8 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:11.068670 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-f68af32c-82d2-49da-b9c9-7184f1b2543b tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:11.069283 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-f68af32c-82d2-49da-b9c9-7184f1b2543b tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] [instance: ebbb4a6b-6863-4efc-8e24-5073fcf14368] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:11.082495 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f68af32c-82d2-49da-b9c9-7184f1b2543b tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:11.084033 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f68af32c-82d2-49da-b9c9-7184f1b2543b tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:11.087372 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f68af32c-82d2-49da-b9c9-7184f1b2543b tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:11.089442 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f68af32c-82d2-49da-b9c9-7184f1b2543b tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:11.116254 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-0048950c-b8c6-44e1-811c-ec3b999e2de8 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:11.137248 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-0048950c-b8c6-44e1-811c-ec3b999e2de8 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:11.142457 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-0048950c-b8c6-44e1-811c-ec3b999e2de8 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:11.143842 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-0048950c-b8c6-44e1-811c-ec3b999e2de8 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1338 microversion: 2.20 time: 0.284990 Aug 07 04:54:11.144396 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 46/87] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:54:10 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1338 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:54:11.429556 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-f68af32c-82d2-49da-b9c9-7184f1b2543b tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa958efbec43feaf2a6341496d7eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbad771114b14d1c813e85f39291b826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:11.438522 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-f68af32c-82d2-49da-b9c9-7184f1b2543b tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] 10.222.0.35 "GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368" status: 200 len: 1315 microversion: 2.1 time: 0.374621 Aug 07 04:54:11.439108 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 42/88] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:11 2021] GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368 => generated 1315 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:11.763343 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-ce9359ca-e927-43c5-90c9-4f2cc0adfb31 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:11.765261 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-ce9359ca-e927-43c5-90c9-4f2cc0adfb31 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:11.770820 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ce9359ca-e927-43c5-90c9-4f2cc0adfb31 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:11.771273 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ce9359ca-e927-43c5-90c9-4f2cc0adfb31 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:11.772063 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ce9359ca-e927-43c5-90c9-4f2cc0adfb31 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:11.772499 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ce9359ca-e927-43c5-90c9-4f2cc0adfb31 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:11.855781 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-701587f7-c0d0-48bb-a573-e5478c264df8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:11.857045 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-701587f7-c0d0-48bb-a573-e5478c264df8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:11.863015 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-701587f7-c0d0-48bb-a573-e5478c264df8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:11.863442 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-701587f7-c0d0-48bb-a573-e5478c264df8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:11.864252 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-701587f7-c0d0-48bb-a573-e5478c264df8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:11.864866 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-701587f7-c0d0-48bb-a573-e5478c264df8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:12.146328 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-701587f7-c0d0-48bb-a573-e5478c264df8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:12.162794 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-701587f7-c0d0-48bb-a573-e5478c264df8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1322 microversion: 2.1 time: 0.311483 Aug 07 04:54:12.173244 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 43/89] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:11 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1322 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:54:12.175253 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-77df0713-ea6f-4589-bffc-41667b386f6a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:12.175870 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-77df0713-ea6f-4589-bffc-41667b386f6a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:12.183980 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-77df0713-ea6f-4589-bffc-41667b386f6a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:12.184554 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-77df0713-ea6f-4589-bffc-41667b386f6a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:12.185615 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-77df0713-ea6f-4589-bffc-41667b386f6a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:12.186252 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-77df0713-ea6f-4589-bffc-41667b386f6a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:12.196280 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-ce9359ca-e927-43c5-90c9-4f2cc0adfb31 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:12.204222 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-ce9359ca-e927-43c5-90c9-4f2cc0adfb31 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b" status: 200 len: 1318 microversion: 2.1 time: 0.445467 Aug 07 04:54:12.216817 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 47/90] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:11 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b => generated 1318 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:12.455849 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-bc8c3701-664d-4531-98f6-65421f399971 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:12.456656 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-bc8c3701-664d-4531-98f6-65421f399971 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] [instance: ebbb4a6b-6863-4efc-8e24-5073fcf14368] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:12.467992 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-bc8c3701-664d-4531-98f6-65421f399971 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:12.468367 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-bc8c3701-664d-4531-98f6-65421f399971 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:12.469205 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-bc8c3701-664d-4531-98f6-65421f399971 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:12.469633 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-bc8c3701-664d-4531-98f6-65421f399971 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:12.707513 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-bc8c3701-664d-4531-98f6-65421f399971 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa958efbec43feaf2a6341496d7eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbad771114b14d1c813e85f39291b826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:12.715380 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-bc8c3701-664d-4531-98f6-65421f399971 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] 10.222.0.35 "GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368" status: 200 len: 1315 microversion: 2.1 time: 0.262645 Aug 07 04:54:12.723352 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 48/91] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:12 2021] GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368 => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:12.750386 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [req-999f608d-8af0-4964-980d-feec70fb4a7e req-8b00e5c0-6348-456a-8a1c-ef5fe02672f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90d6eef5-1c82-472b-adfb-aeaa1e93d502", "tag": "bd78445c-a49c-49cb-abaf-0ddaf6492e2c"}]} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:54:12.752304 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 04:54:12.752304 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: warnings.warn(msg) Aug 07 04:54:12.755218 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-77df0713-ea6f-4589-bffc-41667b386f6a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:12.758928 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-999f608d-8af0-4964-980d-feec70fb4a7e req-8b00e5c0-6348-456a-8a1c-ef5fe02672f6 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:12.759349 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-999f608d-8af0-4964-980d-feec70fb4a7e req-8b00e5c0-6348-456a-8a1c-ef5fe02672f6 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:12.766228 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-77df0713-ea6f-4589-bffc-41667b386f6a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:12.768893 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-77df0713-ea6f-4589-bffc-41667b386f6a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:12.770192 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-77df0713-ea6f-4589-bffc-41667b386f6a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1403 microversion: 2.20 time: 0.599360 Aug 07 04:54:12.770771 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 44/92] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:54:12 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1403 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:54:12.771347 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.compute.server_external_events [req-999f608d-8af0-4964-980d-feec70fb4a7e req-8b00e5c0-6348-456a-8a1c-ef5fe02672f6 service nova] Creating event network-changed:bd78445c-a49c-49cb-abaf-0ddaf6492e2c for instance 90d6eef5-1c82-472b-adfb-aeaa1e93d502 on hv-cinder-80374 Aug 07 04:54:12.782572 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [req-999f608d-8af0-4964-980d-feec70fb4a7e req-8b00e5c0-6348-456a-8a1c-ef5fe02672f6 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044681 Aug 07 04:54:12.783209 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 49/93] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 04:54:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:54:13.179741 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-92c17905-b995-4dd3-903d-29b3a66e8058 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:13.180349 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-92c17905-b995-4dd3-903d-29b3a66e8058 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:13.187172 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-92c17905-b995-4dd3-903d-29b3a66e8058 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:13.187612 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-92c17905-b995-4dd3-903d-29b3a66e8058 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:13.188389 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-92c17905-b995-4dd3-903d-29b3a66e8058 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:13.188807 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-92c17905-b995-4dd3-903d-29b3a66e8058 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:13.234199 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-e3f86db9-4ee9-4893-9f7d-a939a786a9c8 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:13.234897 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-e3f86db9-4ee9-4893-9f7d-a939a786a9c8 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:13.240959 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e3f86db9-4ee9-4893-9f7d-a939a786a9c8 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:13.241408 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e3f86db9-4ee9-4893-9f7d-a939a786a9c8 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:13.242184 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e3f86db9-4ee9-4893-9f7d-a939a786a9c8 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:13.242614 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e3f86db9-4ee9-4893-9f7d-a939a786a9c8 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:13.313253 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-92c17905-b995-4dd3-903d-29b3a66e8058 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:13.320442 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-92c17905-b995-4dd3-903d-29b3a66e8058 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1322 microversion: 2.1 time: 0.144279 Aug 07 04:54:13.321476 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 45/94] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:13 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1322 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:13.364291 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-e3f86db9-4ee9-4893-9f7d-a939a786a9c8 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:13.371568 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-e3f86db9-4ee9-4893-9f7d-a939a786a9c8 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b" status: 200 len: 1318 microversion: 2.1 time: 0.142122 Aug 07 04:54:13.372260 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 50/95] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:13 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b => generated 1318 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:54:13.382603 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [req-a0018ac4-942c-4450-b2f9-0df038995790 req-0e8b8437-70ee-44ac-beb1-ec6f7cf8d422 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7660d04d-3aad-49e0-b8a5-12820fcb4d66", "tag": "8385bf57-9f35-4380-8238-83874f21430a"}]} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:54:13.384869 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 04:54:13.384869 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: warnings.warn(msg) Aug 07 04:54:13.395405 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-a0018ac4-942c-4450-b2f9-0df038995790 req-0e8b8437-70ee-44ac-beb1-ec6f7cf8d422 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:13.395842 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-a0018ac4-942c-4450-b2f9-0df038995790 req-0e8b8437-70ee-44ac-beb1-ec6f7cf8d422 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:13.415630 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.compute.server_external_events [req-a0018ac4-942c-4450-b2f9-0df038995790 req-0e8b8437-70ee-44ac-beb1-ec6f7cf8d422 service nova] Creating event network-changed:8385bf57-9f35-4380-8238-83874f21430a for instance 7660d04d-3aad-49e0-b8a5-12820fcb4d66 on hv-cinder-80374 Aug 07 04:54:13.416128 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-a0018ac4-942c-4450-b2f9-0df038995790 req-0e8b8437-70ee-44ac-beb1-ec6f7cf8d422 service nova] Acquired lock "compute-rpcapi-router" {{(pid=107485) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Aug 07 04:54:13.417230 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-bdd5c92c-4058-4a6c-b710-795895676a0a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:13.417712 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-bdd5c92c-4058-4a6c-b710-795895676a0a None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:13.418490 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-bdd5c92c-4058-4a6c-b710-795895676a0a None None] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:13.418918 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-bdd5c92c-4058-4a6c-b710-795895676a0a None None] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:13.427331 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.compute.rpcapi [None req-bdd5c92c-4058-4a6c-b710-795895676a0a None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Aug 07 04:54:13.428178 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-bdd5c92c-4058-4a6c-b710-795895676a0a None None] Releasing lock "compute-rpcapi-router" {{(pid=107485) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Aug 07 04:54:13.452423 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-bdd5c92c-4058-4a6c-b710-795895676a0a None None] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130264 Aug 07 04:54:13.453046 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 46/96] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 04:54:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:54:13.731015 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-2fdc724b-8e89-4a2f-bb2f-14afc4abca4c tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:13.731896 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-2fdc724b-8e89-4a2f-bb2f-14afc4abca4c tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] [instance: ebbb4a6b-6863-4efc-8e24-5073fcf14368] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:13.737729 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2fdc724b-8e89-4a2f-bb2f-14afc4abca4c tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:13.738255 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2fdc724b-8e89-4a2f-bb2f-14afc4abca4c tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:13.739026 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2fdc724b-8e89-4a2f-bb2f-14afc4abca4c tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:13.739457 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2fdc724b-8e89-4a2f-bb2f-14afc4abca4c tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:13.789670 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-6a186ca5-98a9-4623-afa0-4642c2011537 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:13.790714 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-6a186ca5-98a9-4623-afa0-4642c2011537 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:13.797283 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6a186ca5-98a9-4623-afa0-4642c2011537 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:13.797732 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6a186ca5-98a9-4623-afa0-4642c2011537 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:13.798535 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6a186ca5-98a9-4623-afa0-4642c2011537 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:13.799083 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6a186ca5-98a9-4623-afa0-4642c2011537 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:13.874047 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-2fdc724b-8e89-4a2f-bb2f-14afc4abca4c tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa958efbec43feaf2a6341496d7eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbad771114b14d1c813e85f39291b826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:13.881496 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-2fdc724b-8e89-4a2f-bb2f-14afc4abca4c tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] 10.222.0.35 "GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368" status: 200 len: 1315 microversion: 2.1 time: 0.154098 Aug 07 04:54:13.882063 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 51/97] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:13 2021] GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:13.927913 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-6a186ca5-98a9-4623-afa0-4642c2011537 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:13.936130 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-6a186ca5-98a9-4623-afa0-4642c2011537 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:13.937642 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-6a186ca5-98a9-4623-afa0-4642c2011537 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:13.938719 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-6a186ca5-98a9-4623-afa0-4642c2011537 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1403 microversion: 2.20 time: 0.153494 Aug 07 04:54:13.939271 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 47/98] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:54:13 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1403 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:54:14.337246 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-8721c51a-ff78-4d9f-afd0-1ea8eb7ff64b tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:14.337853 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-8721c51a-ff78-4d9f-afd0-1ea8eb7ff64b tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:14.344696 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8721c51a-ff78-4d9f-afd0-1ea8eb7ff64b tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:14.345172 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8721c51a-ff78-4d9f-afd0-1ea8eb7ff64b tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:14.345928 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8721c51a-ff78-4d9f-afd0-1ea8eb7ff64b tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:14.346358 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8721c51a-ff78-4d9f-afd0-1ea8eb7ff64b tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:14.389787 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-1ec441e4-92ef-43b8-a575-c9d2dd047165 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:14.390382 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-1ec441e4-92ef-43b8-a575-c9d2dd047165 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:14.396145 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1ec441e4-92ef-43b8-a575-c9d2dd047165 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:14.396586 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1ec441e4-92ef-43b8-a575-c9d2dd047165 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:14.397391 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1ec441e4-92ef-43b8-a575-c9d2dd047165 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:14.397825 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1ec441e4-92ef-43b8-a575-c9d2dd047165 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:14.475295 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-8721c51a-ff78-4d9f-afd0-1ea8eb7ff64b tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:14.482751 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-8721c51a-ff78-4d9f-afd0-1ea8eb7ff64b tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1322 microversion: 2.1 time: 0.149106 Aug 07 04:54:14.483313 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 52/99] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:14 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:14.524471 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-1ec441e4-92ef-43b8-a575-c9d2dd047165 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:14.532519 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-1ec441e4-92ef-43b8-a575-c9d2dd047165 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b" status: 200 len: 1318 microversion: 2.1 time: 0.147955 Aug 07 04:54:14.533096 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 48/100] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:14 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:54:14.898722 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-34fac987-3b67-4587-8a97-ff862826c813 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:14.899320 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-34fac987-3b67-4587-8a97-ff862826c813 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] [instance: ebbb4a6b-6863-4efc-8e24-5073fcf14368] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:14.905886 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-34fac987-3b67-4587-8a97-ff862826c813 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:14.906336 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-34fac987-3b67-4587-8a97-ff862826c813 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:14.907101 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-34fac987-3b67-4587-8a97-ff862826c813 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:14.907523 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-34fac987-3b67-4587-8a97-ff862826c813 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:14.955523 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-00c8d928-b468-4ae4-9a91-aabe56a6a283 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:14.956136 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-00c8d928-b468-4ae4-9a91-aabe56a6a283 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:14.961866 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-00c8d928-b468-4ae4-9a91-aabe56a6a283 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:14.962316 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-00c8d928-b468-4ae4-9a91-aabe56a6a283 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:14.963087 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-00c8d928-b468-4ae4-9a91-aabe56a6a283 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:14.963521 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-00c8d928-b468-4ae4-9a91-aabe56a6a283 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:15.030298 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-34fac987-3b67-4587-8a97-ff862826c813 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa958efbec43feaf2a6341496d7eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbad771114b14d1c813e85f39291b826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:15.037771 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-34fac987-3b67-4587-8a97-ff862826c813 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] 10.222.0.35 "GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368" status: 200 len: 1315 microversion: 2.1 time: 0.142600 Aug 07 04:54:15.038339 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 53/101] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:14 2021] GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368 => generated 1315 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:15.082812 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-00c8d928-b468-4ae4-9a91-aabe56a6a283 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:15.091330 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-00c8d928-b468-4ae4-9a91-aabe56a6a283 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:15.092827 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-00c8d928-b468-4ae4-9a91-aabe56a6a283 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:15.093936 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-00c8d928-b468-4ae4-9a91-aabe56a6a283 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1403 microversion: 2.20 time: 0.142108 Aug 07 04:54:15.094501 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 49/102] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:54:14 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1403 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 04:54:15.499404 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-dc90af9d-c3ab-434c-b0fc-e17e9c3948ce tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:15.500007 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-dc90af9d-c3ab-434c-b0fc-e17e9c3948ce tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:15.505924 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-dc90af9d-c3ab-434c-b0fc-e17e9c3948ce tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:15.506362 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-dc90af9d-c3ab-434c-b0fc-e17e9c3948ce tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:15.507112 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-dc90af9d-c3ab-434c-b0fc-e17e9c3948ce tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:15.507536 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-dc90af9d-c3ab-434c-b0fc-e17e9c3948ce tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:15.549397 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-fd98cafb-f8df-495f-a17f-3d2d1d284090 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:15.550007 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-fd98cafb-f8df-495f-a17f-3d2d1d284090 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:15.555835 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-fd98cafb-f8df-495f-a17f-3d2d1d284090 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:15.556275 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-fd98cafb-f8df-495f-a17f-3d2d1d284090 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:15.557060 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-fd98cafb-f8df-495f-a17f-3d2d1d284090 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:15.557490 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-fd98cafb-f8df-495f-a17f-3d2d1d284090 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:15.626055 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-dc90af9d-c3ab-434c-b0fc-e17e9c3948ce tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:15.633340 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-dc90af9d-c3ab-434c-b0fc-e17e9c3948ce tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1322 microversion: 2.1 time: 0.137773 Aug 07 04:54:15.633899 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 54/103] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:15 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1322 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:15.677626 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-fd98cafb-f8df-495f-a17f-3d2d1d284090 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:15.685366 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-fd98cafb-f8df-495f-a17f-3d2d1d284090 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b" status: 200 len: 1318 microversion: 2.1 time: 0.139536 Aug 07 04:54:15.685922 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 50/104] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:15 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b => generated 1318 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:54:16.054298 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-40cdacee-dae9-42db-9775-9f8a9d89d448 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:16.054908 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-40cdacee-dae9-42db-9775-9f8a9d89d448 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] [instance: ebbb4a6b-6863-4efc-8e24-5073fcf14368] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:16.061064 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-40cdacee-dae9-42db-9775-9f8a9d89d448 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:16.061593 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-40cdacee-dae9-42db-9775-9f8a9d89d448 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:16.066505 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-40cdacee-dae9-42db-9775-9f8a9d89d448 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:16.066948 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-40cdacee-dae9-42db-9775-9f8a9d89d448 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:16.111971 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-86c0495b-8d38-4f22-9590-0f5341a0aa2d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:16.112621 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-86c0495b-8d38-4f22-9590-0f5341a0aa2d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:16.118642 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-86c0495b-8d38-4f22-9590-0f5341a0aa2d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:16.119197 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-86c0495b-8d38-4f22-9590-0f5341a0aa2d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:16.120018 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-86c0495b-8d38-4f22-9590-0f5341a0aa2d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:16.120455 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-86c0495b-8d38-4f22-9590-0f5341a0aa2d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:16.277739 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-86c0495b-8d38-4f22-9590-0f5341a0aa2d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:16.280778 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-40cdacee-dae9-42db-9775-9f8a9d89d448 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa958efbec43feaf2a6341496d7eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbad771114b14d1c813e85f39291b826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:16.288971 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-40cdacee-dae9-42db-9775-9f8a9d89d448 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] 10.222.0.35 "GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368" status: 200 len: 1315 microversion: 2.1 time: 0.238432 Aug 07 04:54:16.289770 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 55/105] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:16 2021] GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368 => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:54:16.291815 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-86c0495b-8d38-4f22-9590-0f5341a0aa2d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:16.293840 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-86c0495b-8d38-4f22-9590-0f5341a0aa2d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:16.294924 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-86c0495b-8d38-4f22-9590-0f5341a0aa2d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1403 microversion: 2.20 time: 0.186721 Aug 07 04:54:16.295462 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 51/106] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:54:16 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1403 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 04:54:16.650508 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-79139ea3-a47d-4637-b51c-3dad9c3abdd9 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:16.651123 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-79139ea3-a47d-4637-b51c-3dad9c3abdd9 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:16.657376 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-79139ea3-a47d-4637-b51c-3dad9c3abdd9 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:16.657807 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-79139ea3-a47d-4637-b51c-3dad9c3abdd9 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:16.658773 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-79139ea3-a47d-4637-b51c-3dad9c3abdd9 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:16.659016 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-79139ea3-a47d-4637-b51c-3dad9c3abdd9 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:16.702248 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-6961f545-c564-4209-adc4-782ba67309df tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:16.703029 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-6961f545-c564-4209-adc4-782ba67309df tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:16.708930 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6961f545-c564-4209-adc4-782ba67309df tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:16.709444 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6961f545-c564-4209-adc4-782ba67309df tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:16.710298 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6961f545-c564-4209-adc4-782ba67309df tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:16.710791 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6961f545-c564-4209-adc4-782ba67309df tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:16.862912 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-6961f545-c564-4209-adc4-782ba67309df tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:16.870670 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-6961f545-c564-4209-adc4-782ba67309df tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b" status: 200 len: 1318 microversion: 2.1 time: 0.172511 Aug 07 04:54:16.880129 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 52/107] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:16 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:16.897142 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-79139ea3-a47d-4637-b51c-3dad9c3abdd9 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:16.905635 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-79139ea3-a47d-4637-b51c-3dad9c3abdd9 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1322 microversion: 2.1 time: 0.258826 Aug 07 04:54:16.906842 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 56/108] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:16 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1322 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:17.147224 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [req-9a90966f-504f-47ed-9308-fc9ca9399d84 req-bb38af86-078e-4d7a-9bf7-f54f0f264407 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "431857b6-a453-44f0-829c-00ed610d5fc2", "tag": "6a0264c8-c45c-4fec-b570-31fbf0131107"}]} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:54:17.149260 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 04:54:17.149260 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: warnings.warn(msg) Aug 07 04:54:17.164935 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-9a90966f-504f-47ed-9308-fc9ca9399d84 req-bb38af86-078e-4d7a-9bf7-f54f0f264407 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:17.165696 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-9a90966f-504f-47ed-9308-fc9ca9399d84 req-bb38af86-078e-4d7a-9bf7-f54f0f264407 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:17.178064 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.compute.server_external_events [req-9a90966f-504f-47ed-9308-fc9ca9399d84 req-bb38af86-078e-4d7a-9bf7-f54f0f264407 service nova] Creating event network-changed:6a0264c8-c45c-4fec-b570-31fbf0131107 for instance 431857b6-a453-44f0-829c-00ed610d5fc2 on hv-cinder-80374 Aug 07 04:54:17.183538 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [req-9a90966f-504f-47ed-9308-fc9ca9399d84 req-bb38af86-078e-4d7a-9bf7-f54f0f264407 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040994 Aug 07 04:54:17.184301 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 53/109] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 04:54:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:54:17.326517 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-5aef4fe4-35ee-4be6-a1ff-ebeb85ba6b72 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:17.328701 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-5aef4fe4-35ee-4be6-a1ff-ebeb85ba6b72 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] [instance: ebbb4a6b-6863-4efc-8e24-5073fcf14368] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:17.329129 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-dd000046-85cb-4ae2-9e11-a5c9dbb0dec2 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:17.331333 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-dd000046-85cb-4ae2-9e11-a5c9dbb0dec2 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:17.356676 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5aef4fe4-35ee-4be6-a1ff-ebeb85ba6b72 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:17.359194 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5aef4fe4-35ee-4be6-a1ff-ebeb85ba6b72 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:17.361070 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-dd000046-85cb-4ae2-9e11-a5c9dbb0dec2 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:17.361685 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-dd000046-85cb-4ae2-9e11-a5c9dbb0dec2 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:17.362663 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5aef4fe4-35ee-4be6-a1ff-ebeb85ba6b72 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:17.363454 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5aef4fe4-35ee-4be6-a1ff-ebeb85ba6b72 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:17.367401 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-dd000046-85cb-4ae2-9e11-a5c9dbb0dec2 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:17.367653 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-dd000046-85cb-4ae2-9e11-a5c9dbb0dec2 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:17.608823 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-dd000046-85cb-4ae2-9e11-a5c9dbb0dec2 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:17.621672 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-dd000046-85cb-4ae2-9e11-a5c9dbb0dec2 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:17.623559 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-dd000046-85cb-4ae2-9e11-a5c9dbb0dec2 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:17.624821 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-dd000046-85cb-4ae2-9e11-a5c9dbb0dec2 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1403 microversion: 2.20 time: 0.314974 Aug 07 04:54:17.625377 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 54/110] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:54:17 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1403 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:54:17.669914 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-5aef4fe4-35ee-4be6-a1ff-ebeb85ba6b72 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa958efbec43feaf2a6341496d7eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbad771114b14d1c813e85f39291b826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:17.677045 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-5aef4fe4-35ee-4be6-a1ff-ebeb85ba6b72 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] 10.222.0.35 "GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368" status: 200 len: 1315 microversion: 2.1 time: 0.373343 Aug 07 04:54:17.677598 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 57/111] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:17 2021] GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368 => generated 1315 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:17.887799 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-eb20715d-b002-4d62-9b89-2ee32486ba0b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:17.889413 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-eb20715d-b002-4d62-9b89-2ee32486ba0b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:17.896277 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-eb20715d-b002-4d62-9b89-2ee32486ba0b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:17.896425 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-eb20715d-b002-4d62-9b89-2ee32486ba0b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:17.897222 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-eb20715d-b002-4d62-9b89-2ee32486ba0b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:17.897651 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-eb20715d-b002-4d62-9b89-2ee32486ba0b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:17.922730 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-dee59b17-3931-4641-938c-241eab89f1f9 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:17.923504 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-dee59b17-3931-4641-938c-241eab89f1f9 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:17.929529 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-dee59b17-3931-4641-938c-241eab89f1f9 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:17.930062 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-dee59b17-3931-4641-938c-241eab89f1f9 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:17.931106 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-dee59b17-3931-4641-938c-241eab89f1f9 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:17.931623 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-dee59b17-3931-4641-938c-241eab89f1f9 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:18.020283 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-eb20715d-b002-4d62-9b89-2ee32486ba0b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:18.028250 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-eb20715d-b002-4d62-9b89-2ee32486ba0b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b" status: 200 len: 1318 microversion: 2.1 time: 0.144681 Aug 07 04:54:18.028831 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 55/112] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:17 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:18.115706 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-dee59b17-3931-4641-938c-241eab89f1f9 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:18.126085 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-dee59b17-3931-4641-938c-241eab89f1f9 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1322 microversion: 2.1 time: 0.206932 Aug 07 04:54:18.129680 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 58/113] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:17 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:18.642170 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-569e676e-8fe6-4fef-aa2f-52bd94f45278 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:18.642766 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-569e676e-8fe6-4fef-aa2f-52bd94f45278 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:18.648736 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-569e676e-8fe6-4fef-aa2f-52bd94f45278 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:18.649229 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-569e676e-8fe6-4fef-aa2f-52bd94f45278 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:18.649967 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-569e676e-8fe6-4fef-aa2f-52bd94f45278 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:18.650395 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-569e676e-8fe6-4fef-aa2f-52bd94f45278 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:18.694518 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-239ea7ca-42de-47bc-8752-3fd0b0e30733 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:18.695132 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-239ea7ca-42de-47bc-8752-3fd0b0e30733 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] [instance: ebbb4a6b-6863-4efc-8e24-5073fcf14368] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:18.701498 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-239ea7ca-42de-47bc-8752-3fd0b0e30733 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:18.701948 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-239ea7ca-42de-47bc-8752-3fd0b0e30733 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:18.702717 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-239ea7ca-42de-47bc-8752-3fd0b0e30733 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:18.703153 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-239ea7ca-42de-47bc-8752-3fd0b0e30733 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:18.767711 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-569e676e-8fe6-4fef-aa2f-52bd94f45278 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:18.775535 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-569e676e-8fe6-4fef-aa2f-52bd94f45278 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:18.777836 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-569e676e-8fe6-4fef-aa2f-52bd94f45278 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:18.778930 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-569e676e-8fe6-4fef-aa2f-52bd94f45278 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1403 microversion: 2.20 time: 0.140536 Aug 07 04:54:18.779498 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 56/114] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:54:18 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1403 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:54:18.826362 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-239ea7ca-42de-47bc-8752-3fd0b0e30733 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa958efbec43feaf2a6341496d7eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbad771114b14d1c813e85f39291b826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:18.834587 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-239ea7ca-42de-47bc-8752-3fd0b0e30733 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] 10.222.0.35 "GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368" status: 200 len: 1315 microversion: 2.1 time: 0.143642 Aug 07 04:54:18.835143 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 59/115] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:18 2021] GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368 => generated 1315 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:54:19.045322 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-7f90feee-720c-4d0b-8332-f52ac0cebd50 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:19.046015 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-7f90feee-720c-4d0b-8332-f52ac0cebd50 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:19.052262 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7f90feee-720c-4d0b-8332-f52ac0cebd50 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:19.052709 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7f90feee-720c-4d0b-8332-f52ac0cebd50 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:19.053568 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7f90feee-720c-4d0b-8332-f52ac0cebd50 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:19.054127 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7f90feee-720c-4d0b-8332-f52ac0cebd50 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:19.142294 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-ae3a1371-ede9-4376-ad91-a3221f610485 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:19.142916 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-ae3a1371-ede9-4376-ad91-a3221f610485 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:19.148780 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ae3a1371-ede9-4376-ad91-a3221f610485 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:19.149259 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ae3a1371-ede9-4376-ad91-a3221f610485 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:19.150028 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ae3a1371-ede9-4376-ad91-a3221f610485 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:19.150464 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ae3a1371-ede9-4376-ad91-a3221f610485 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:19.179873 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-7f90feee-720c-4d0b-8332-f52ac0cebd50 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:19.188373 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-7f90feee-720c-4d0b-8332-f52ac0cebd50 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b" status: 200 len: 1318 microversion: 2.1 time: 0.147586 Aug 07 04:54:19.188980 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 57/116] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:19 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:19.276627 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-ae3a1371-ede9-4376-ad91-a3221f610485 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:19.284454 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-ae3a1371-ede9-4376-ad91-a3221f610485 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1322 microversion: 2.1 time: 0.145826 Aug 07 04:54:19.285056 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 60/117] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:19 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:54:19.796913 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-3b4701c0-9aa4-4aaf-92e2-1866cf87ac32 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:19.797519 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-3b4701c0-9aa4-4aaf-92e2-1866cf87ac32 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:19.805364 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3b4701c0-9aa4-4aaf-92e2-1866cf87ac32 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:19.805836 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3b4701c0-9aa4-4aaf-92e2-1866cf87ac32 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:19.806613 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3b4701c0-9aa4-4aaf-92e2-1866cf87ac32 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:19.807049 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3b4701c0-9aa4-4aaf-92e2-1866cf87ac32 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:19.851342 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-82ee6054-ef9f-48c2-b339-c8f1db2d0551 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:19.851871 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-82ee6054-ef9f-48c2-b339-c8f1db2d0551 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] [instance: ebbb4a6b-6863-4efc-8e24-5073fcf14368] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:19.858485 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-82ee6054-ef9f-48c2-b339-c8f1db2d0551 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:19.858931 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-82ee6054-ef9f-48c2-b339-c8f1db2d0551 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:19.859713 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-82ee6054-ef9f-48c2-b339-c8f1db2d0551 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:19.860148 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-82ee6054-ef9f-48c2-b339-c8f1db2d0551 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:19.951729 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-3b4701c0-9aa4-4aaf-92e2-1866cf87ac32 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:19.959728 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-3b4701c0-9aa4-4aaf-92e2-1866cf87ac32 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:19.961315 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-3b4701c0-9aa4-4aaf-92e2-1866cf87ac32 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:19.962471 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-3b4701c0-9aa4-4aaf-92e2-1866cf87ac32 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1403 microversion: 2.20 time: 0.169300 Aug 07 04:54:19.963100 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 58/118] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:54:19 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1403 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:54:20.000758 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-82ee6054-ef9f-48c2-b339-c8f1db2d0551 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa958efbec43feaf2a6341496d7eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbad771114b14d1c813e85f39291b826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:20.008363 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-82ee6054-ef9f-48c2-b339-c8f1db2d0551 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] 10.222.0.35 "GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368" status: 200 len: 1315 microversion: 2.1 time: 0.160741 Aug 07 04:54:20.008981 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 61/119] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:19 2021] GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:54:20.205394 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-1963bf0a-a8ef-4ffd-83f7-4d1f75f6a1d0 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:20.206005 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-1963bf0a-a8ef-4ffd-83f7-4d1f75f6a1d0 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:20.212423 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1963bf0a-a8ef-4ffd-83f7-4d1f75f6a1d0 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:20.212890 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1963bf0a-a8ef-4ffd-83f7-4d1f75f6a1d0 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:20.213675 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1963bf0a-a8ef-4ffd-83f7-4d1f75f6a1d0 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:20.214131 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1963bf0a-a8ef-4ffd-83f7-4d1f75f6a1d0 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:20.301178 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-e0b62f77-2bd2-4393-bd8e-14b2cfe8a447 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:20.301800 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-e0b62f77-2bd2-4393-bd8e-14b2cfe8a447 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:20.307733 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e0b62f77-2bd2-4393-bd8e-14b2cfe8a447 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:20.308808 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e0b62f77-2bd2-4393-bd8e-14b2cfe8a447 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:20.309594 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e0b62f77-2bd2-4393-bd8e-14b2cfe8a447 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:20.310035 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e0b62f77-2bd2-4393-bd8e-14b2cfe8a447 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:20.340941 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-1963bf0a-a8ef-4ffd-83f7-4d1f75f6a1d0 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:20.348117 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-1963bf0a-a8ef-4ffd-83f7-4d1f75f6a1d0 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b" status: 200 len: 1318 microversion: 2.1 time: 0.146507 Aug 07 04:54:20.348679 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 59/120] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:20 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:20.437393 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-e0b62f77-2bd2-4393-bd8e-14b2cfe8a447 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:20.444776 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-e0b62f77-2bd2-4393-bd8e-14b2cfe8a447 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1322 microversion: 2.1 time: 0.147189 Aug 07 04:54:20.445377 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 62/121] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:20 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:54:20.986416 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-07fa3e22-f4f8-44a8-a827-e842d618a1ed tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:20.987109 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-07fa3e22-f4f8-44a8-a827-e842d618a1ed tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:20.993046 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-07fa3e22-f4f8-44a8-a827-e842d618a1ed tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:20.993499 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-07fa3e22-f4f8-44a8-a827-e842d618a1ed tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:20.994278 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-07fa3e22-f4f8-44a8-a827-e842d618a1ed tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:20.994706 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-07fa3e22-f4f8-44a8-a827-e842d618a1ed tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:21.025522 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-90ad3f4b-4e95-408f-b639-2ee44928ef8c tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:21.026132 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-90ad3f4b-4e95-408f-b639-2ee44928ef8c tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] [instance: ebbb4a6b-6863-4efc-8e24-5073fcf14368] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:21.032890 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-90ad3f4b-4e95-408f-b639-2ee44928ef8c tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:21.033338 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-90ad3f4b-4e95-408f-b639-2ee44928ef8c tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:21.034118 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-90ad3f4b-4e95-408f-b639-2ee44928ef8c tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:21.034550 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-90ad3f4b-4e95-408f-b639-2ee44928ef8c tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:21.119206 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-07fa3e22-f4f8-44a8-a827-e842d618a1ed tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:21.127341 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-07fa3e22-f4f8-44a8-a827-e842d618a1ed tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:21.128984 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-07fa3e22-f4f8-44a8-a827-e842d618a1ed tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:21.130160 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-07fa3e22-f4f8-44a8-a827-e842d618a1ed tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1403 microversion: 2.20 time: 0.147468 Aug 07 04:54:21.130781 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 60/122] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:54:20 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1403 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:54:21.160058 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-90ad3f4b-4e95-408f-b639-2ee44928ef8c tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa958efbec43feaf2a6341496d7eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbad771114b14d1c813e85f39291b826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:21.167262 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-90ad3f4b-4e95-408f-b639-2ee44928ef8c tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] 10.222.0.35 "GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368" status: 200 len: 1315 microversion: 2.1 time: 0.145385 Aug 07 04:54:21.168162 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 63/123] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:21 2021] GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:54:21.365207 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-70c97ceb-6270-49d1-b0bf-8345959753fd tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:21.365846 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-70c97ceb-6270-49d1-b0bf-8345959753fd tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:21.372179 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-70c97ceb-6270-49d1-b0bf-8345959753fd tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:21.372622 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-70c97ceb-6270-49d1-b0bf-8345959753fd tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:21.373414 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-70c97ceb-6270-49d1-b0bf-8345959753fd tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:21.373850 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-70c97ceb-6270-49d1-b0bf-8345959753fd tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:21.461093 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-ec1fe052-6be5-490a-898b-5743f13b7029 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:21.461730 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-ec1fe052-6be5-490a-898b-5743f13b7029 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:21.467875 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ec1fe052-6be5-490a-898b-5743f13b7029 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:21.468319 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ec1fe052-6be5-490a-898b-5743f13b7029 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:21.469108 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ec1fe052-6be5-490a-898b-5743f13b7029 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:21.469540 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ec1fe052-6be5-490a-898b-5743f13b7029 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:21.491150 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-70c97ceb-6270-49d1-b0bf-8345959753fd tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:21.499060 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-70c97ceb-6270-49d1-b0bf-8345959753fd tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b" status: 200 len: 1318 microversion: 2.1 time: 0.137473 Aug 07 04:54:21.499632 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 61/124] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:21 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b => generated 1318 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:21.600611 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-ec1fe052-6be5-490a-898b-5743f13b7029 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:21.608629 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-ec1fe052-6be5-490a-898b-5743f13b7029 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1322 microversion: 2.1 time: 0.151170 Aug 07 04:54:21.609242 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 64/125] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:21 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:54:22.147353 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-93058ee9-0607-4923-a20b-5430f258cd26 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:22.147962 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-93058ee9-0607-4923-a20b-5430f258cd26 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:22.154398 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-93058ee9-0607-4923-a20b-5430f258cd26 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:22.155066 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-93058ee9-0607-4923-a20b-5430f258cd26 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:22.158051 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-93058ee9-0607-4923-a20b-5430f258cd26 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:22.158512 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-93058ee9-0607-4923-a20b-5430f258cd26 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:22.183151 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-5667550d-8d6a-4825-974f-1b40f15c19f6 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:22.184126 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-5667550d-8d6a-4825-974f-1b40f15c19f6 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] [instance: ebbb4a6b-6863-4efc-8e24-5073fcf14368] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:22.190042 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5667550d-8d6a-4825-974f-1b40f15c19f6 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:22.190485 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5667550d-8d6a-4825-974f-1b40f15c19f6 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:22.192156 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5667550d-8d6a-4825-974f-1b40f15c19f6 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:22.192156 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5667550d-8d6a-4825-974f-1b40f15c19f6 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:22.325875 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-93058ee9-0607-4923-a20b-5430f258cd26 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:22.334244 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-93058ee9-0607-4923-a20b-5430f258cd26 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:22.335946 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-93058ee9-0607-4923-a20b-5430f258cd26 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:22.337130 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-93058ee9-0607-4923-a20b-5430f258cd26 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1403 microversion: 2.20 time: 0.193561 Aug 07 04:54:22.338136 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 62/126] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:54:22 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1403 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 04:54:22.437027 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-5667550d-8d6a-4825-974f-1b40f15c19f6 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa958efbec43feaf2a6341496d7eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbad771114b14d1c813e85f39291b826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:22.444646 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-5667550d-8d6a-4825-974f-1b40f15c19f6 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] 10.222.0.35 "GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368" status: 200 len: 1315 microversion: 2.1 time: 0.265166 Aug 07 04:54:22.445244 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 65/127] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:22 2021] GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368 => generated 1315 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:54:22.515646 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-1b20b174-974a-4e54-a7ab-7379efe7684f tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:22.516277 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-1b20b174-974a-4e54-a7ab-7379efe7684f tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:22.522082 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1b20b174-974a-4e54-a7ab-7379efe7684f tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:22.522534 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1b20b174-974a-4e54-a7ab-7379efe7684f tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:22.523304 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1b20b174-974a-4e54-a7ab-7379efe7684f tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:22.523743 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1b20b174-974a-4e54-a7ab-7379efe7684f tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:22.627628 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-3b29506d-d826-4dfe-9480-9f5733350f86 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:22.628173 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-3b29506d-d826-4dfe-9480-9f5733350f86 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:22.634373 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3b29506d-d826-4dfe-9480-9f5733350f86 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:22.634828 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3b29506d-d826-4dfe-9480-9f5733350f86 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:22.635608 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3b29506d-d826-4dfe-9480-9f5733350f86 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:22.636542 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3b29506d-d826-4dfe-9480-9f5733350f86 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:22.664850 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-1b20b174-974a-4e54-a7ab-7379efe7684f tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:22.675409 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-1b20b174-974a-4e54-a7ab-7379efe7684f tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b" status: 200 len: 1318 microversion: 2.1 time: 0.163333 Aug 07 04:54:22.676321 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 63/128] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:22 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:22.769493 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-3b29506d-d826-4dfe-9480-9f5733350f86 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:22.776676 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-3b29506d-d826-4dfe-9480-9f5733350f86 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1322 microversion: 2.1 time: 0.154981 Aug 07 04:54:22.777842 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 66/129] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:22 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:23.355182 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-852d4093-4f39-41ab-9c6a-2a385e41ca18 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:23.355767 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-852d4093-4f39-41ab-9c6a-2a385e41ca18 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:23.361608 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-852d4093-4f39-41ab-9c6a-2a385e41ca18 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:23.362045 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-852d4093-4f39-41ab-9c6a-2a385e41ca18 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:23.362799 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-852d4093-4f39-41ab-9c6a-2a385e41ca18 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:23.363220 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-852d4093-4f39-41ab-9c6a-2a385e41ca18 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:23.462193 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-f398eef3-2be6-4e77-9a9e-1e6220a346fe tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:23.462797 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-f398eef3-2be6-4e77-9a9e-1e6220a346fe tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] [instance: ebbb4a6b-6863-4efc-8e24-5073fcf14368] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:23.470172 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f398eef3-2be6-4e77-9a9e-1e6220a346fe tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:23.470853 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f398eef3-2be6-4e77-9a9e-1e6220a346fe tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:23.471738 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f398eef3-2be6-4e77-9a9e-1e6220a346fe tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:23.472357 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f398eef3-2be6-4e77-9a9e-1e6220a346fe tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:23.483727 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-852d4093-4f39-41ab-9c6a-2a385e41ca18 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:23.491635 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-852d4093-4f39-41ab-9c6a-2a385e41ca18 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:23.493265 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-852d4093-4f39-41ab-9c6a-2a385e41ca18 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:23.494580 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-852d4093-4f39-41ab-9c6a-2a385e41ca18 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1403 microversion: 2.20 time: 0.143112 Aug 07 04:54:23.495906 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 64/130] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:54:23 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1403 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:54:23.599770 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-f398eef3-2be6-4e77-9a9e-1e6220a346fe tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa958efbec43feaf2a6341496d7eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbad771114b14d1c813e85f39291b826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:23.607665 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-f398eef3-2be6-4e77-9a9e-1e6220a346fe tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] 10.222.0.35 "GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368" status: 200 len: 1315 microversion: 2.1 time: 0.149407 Aug 07 04:54:23.608243 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 67/131] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:23 2021] GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:54:23.691556 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-5e214265-03ec-47f3-911e-6a61cf3697ab tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:23.692236 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-5e214265-03ec-47f3-911e-6a61cf3697ab tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:23.698126 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5e214265-03ec-47f3-911e-6a61cf3697ab tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:23.699195 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5e214265-03ec-47f3-911e-6a61cf3697ab tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:23.699970 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5e214265-03ec-47f3-911e-6a61cf3697ab tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:23.700405 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5e214265-03ec-47f3-911e-6a61cf3697ab tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:23.798836 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-5a4c6980-e014-459d-a748-4436b6ca27e0 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:23.799474 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-5a4c6980-e014-459d-a748-4436b6ca27e0 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:23.806060 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5a4c6980-e014-459d-a748-4436b6ca27e0 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:23.806884 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5a4c6980-e014-459d-a748-4436b6ca27e0 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:23.809012 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5a4c6980-e014-459d-a748-4436b6ca27e0 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:23.809600 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5a4c6980-e014-459d-a748-4436b6ca27e0 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:23.847597 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-5e214265-03ec-47f3-911e-6a61cf3697ab tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:23.855948 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-5e214265-03ec-47f3-911e-6a61cf3697ab tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b" status: 200 len: 1318 microversion: 2.1 time: 0.168291 Aug 07 04:54:23.857399 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 65/132] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:23 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:23.948133 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-5a4c6980-e014-459d-a748-4436b6ca27e0 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:23.957435 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-5a4c6980-e014-459d-a748-4436b6ca27e0 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1322 microversion: 2.1 time: 0.167389 Aug 07 04:54:23.958033 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 68/133] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:23 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:24.513626 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-5e771d7a-7376-4089-9b4a-1490124c8476 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:24.514228 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-5e771d7a-7376-4089-9b4a-1490124c8476 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:24.524644 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5e771d7a-7376-4089-9b4a-1490124c8476 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:24.525732 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5e771d7a-7376-4089-9b4a-1490124c8476 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:24.527137 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5e771d7a-7376-4089-9b4a-1490124c8476 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:24.528622 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5e771d7a-7376-4089-9b4a-1490124c8476 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:24.623607 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-90169dfc-7740-47c4-a181-837d07d86b17 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:24.624233 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-90169dfc-7740-47c4-a181-837d07d86b17 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] [instance: ebbb4a6b-6863-4efc-8e24-5073fcf14368] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:24.630892 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-90169dfc-7740-47c4-a181-837d07d86b17 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:24.631338 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-90169dfc-7740-47c4-a181-837d07d86b17 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:24.632128 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-90169dfc-7740-47c4-a181-837d07d86b17 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:24.632559 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-90169dfc-7740-47c4-a181-837d07d86b17 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:24.766108 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-90169dfc-7740-47c4-a181-837d07d86b17 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa958efbec43feaf2a6341496d7eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbad771114b14d1c813e85f39291b826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:24.773733 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-90169dfc-7740-47c4-a181-837d07d86b17 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] 10.222.0.35 "GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368" status: 200 len: 1315 microversion: 2.1 time: 0.154072 Aug 07 04:54:24.774411 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 69/134] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:24 2021] GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:54:24.833491 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-5e771d7a-7376-4089-9b4a-1490124c8476 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:24.844251 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-5e771d7a-7376-4089-9b4a-1490124c8476 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:24.845810 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-5e771d7a-7376-4089-9b4a-1490124c8476 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:24.846902 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-5e771d7a-7376-4089-9b4a-1490124c8476 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1403 microversion: 2.20 time: 0.338084 Aug 07 04:54:24.847456 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 66/135] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:54:24 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1403 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:54:24.873533 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-7fb2235f-9ec5-4ac8-a6fb-ba68715ffd01 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:24.874239 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-7fb2235f-9ec5-4ac8-a6fb-ba68715ffd01 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:24.880258 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-7fb2235f-9ec5-4ac8-a6fb-ba68715ffd01 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:24.880701 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-7fb2235f-9ec5-4ac8-a6fb-ba68715ffd01 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:24.881496 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-7fb2235f-9ec5-4ac8-a6fb-ba68715ffd01 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:24.881925 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-7fb2235f-9ec5-4ac8-a6fb-ba68715ffd01 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:24.976699 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-6fdda153-092d-418f-9bf3-7064e7857fae tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:24.977587 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-6fdda153-092d-418f-9bf3-7064e7857fae tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:24.985200 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6fdda153-092d-418f-9bf3-7064e7857fae tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:24.985852 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6fdda153-092d-418f-9bf3-7064e7857fae tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:24.986842 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6fdda153-092d-418f-9bf3-7064e7857fae tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:24.987637 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6fdda153-092d-418f-9bf3-7064e7857fae tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:25.007078 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-7fb2235f-9ec5-4ac8-a6fb-ba68715ffd01 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:25.015074 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-7fb2235f-9ec5-4ac8-a6fb-ba68715ffd01 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b" status: 200 len: 1318 microversion: 2.1 time: 0.146063 Aug 07 04:54:25.015582 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 70/136] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:24 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:54:25.130347 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-6fdda153-092d-418f-9bf3-7064e7857fae tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:25.138529 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-6fdda153-092d-418f-9bf3-7064e7857fae tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1322 microversion: 2.1 time: 0.166452 Aug 07 04:54:25.139113 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 67/137] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:24 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:54:25.790596 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-809be403-1412-44e8-abd1-5ced9c7d60db tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:25.791759 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-809be403-1412-44e8-abd1-5ced9c7d60db tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] [instance: ebbb4a6b-6863-4efc-8e24-5073fcf14368] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:25.797839 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-809be403-1412-44e8-abd1-5ced9c7d60db tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:25.798275 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-809be403-1412-44e8-abd1-5ced9c7d60db tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:25.799164 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-809be403-1412-44e8-abd1-5ced9c7d60db tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:25.799439 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-809be403-1412-44e8-abd1-5ced9c7d60db tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:25.865008 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-723e579f-3676-4562-b5f5-13af794667a0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:25.865713 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-723e579f-3676-4562-b5f5-13af794667a0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:25.873046 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-723e579f-3676-4562-b5f5-13af794667a0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:25.873499 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-723e579f-3676-4562-b5f5-13af794667a0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:25.874289 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-723e579f-3676-4562-b5f5-13af794667a0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:25.874722 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-723e579f-3676-4562-b5f5-13af794667a0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:25.935955 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-809be403-1412-44e8-abd1-5ced9c7d60db tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa958efbec43feaf2a6341496d7eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbad771114b14d1c813e85f39291b826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:25.945074 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-809be403-1412-44e8-abd1-5ced9c7d60db tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] 10.222.0.35 "GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368" status: 200 len: 1315 microversion: 2.1 time: 0.157963 Aug 07 04:54:25.949147 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 71/138] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:25 2021] GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:26.010884 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-723e579f-3676-4562-b5f5-13af794667a0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:26.019295 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-723e579f-3676-4562-b5f5-13af794667a0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:26.021535 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-723e579f-3676-4562-b5f5-13af794667a0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:26.022734 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-723e579f-3676-4562-b5f5-13af794667a0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1403 microversion: 2.20 time: 0.161401 Aug 07 04:54:26.023283 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 68/139] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:54:25 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1403 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 04:54:26.033328 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-6a12dde7-2add-4451-a32d-77f027db5f89 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:26.034209 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-6a12dde7-2add-4451-a32d-77f027db5f89 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:26.040556 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6a12dde7-2add-4451-a32d-77f027db5f89 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:26.041032 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6a12dde7-2add-4451-a32d-77f027db5f89 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:26.041855 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6a12dde7-2add-4451-a32d-77f027db5f89 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:26.042682 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6a12dde7-2add-4451-a32d-77f027db5f89 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:26.155732 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-612683e7-f65d-44cc-8126-495c026e0fd8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:26.156659 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-612683e7-f65d-44cc-8126-495c026e0fd8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:26.162594 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-612683e7-f65d-44cc-8126-495c026e0fd8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:26.163122 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-612683e7-f65d-44cc-8126-495c026e0fd8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:26.163960 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-612683e7-f65d-44cc-8126-495c026e0fd8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:26.164455 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-612683e7-f65d-44cc-8126-495c026e0fd8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:26.178215 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-6a12dde7-2add-4451-a32d-77f027db5f89 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:26.186705 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-6a12dde7-2add-4451-a32d-77f027db5f89 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b" status: 200 len: 1318 microversion: 2.1 time: 0.156971 Aug 07 04:54:26.187498 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 72/140] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:26 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:26.284681 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-612683e7-f65d-44cc-8126-495c026e0fd8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:26.292211 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-612683e7-f65d-44cc-8126-495c026e0fd8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1322 microversion: 2.1 time: 0.140646 Aug 07 04:54:26.302522 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 69/141] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:26 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1322 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:54:26.968875 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-1e6bcdf2-2ac3-4916-860f-0de69d11b72b tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:26.969784 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-1e6bcdf2-2ac3-4916-860f-0de69d11b72b tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] [instance: ebbb4a6b-6863-4efc-8e24-5073fcf14368] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:26.977895 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1e6bcdf2-2ac3-4916-860f-0de69d11b72b tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:26.978834 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1e6bcdf2-2ac3-4916-860f-0de69d11b72b tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:26.981116 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1e6bcdf2-2ac3-4916-860f-0de69d11b72b tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:26.981770 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1e6bcdf2-2ac3-4916-860f-0de69d11b72b tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:27.041536 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-e7d30106-7822-4883-8a2b-e0d586b34dc7 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:27.043417 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-e7d30106-7822-4883-8a2b-e0d586b34dc7 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:27.052621 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e7d30106-7822-4883-8a2b-e0d586b34dc7 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:27.054625 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e7d30106-7822-4883-8a2b-e0d586b34dc7 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:27.056344 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e7d30106-7822-4883-8a2b-e0d586b34dc7 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:27.060457 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e7d30106-7822-4883-8a2b-e0d586b34dc7 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:27.150321 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-1e6bcdf2-2ac3-4916-860f-0de69d11b72b tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa958efbec43feaf2a6341496d7eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbad771114b14d1c813e85f39291b826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:27.161434 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-1e6bcdf2-2ac3-4916-860f-0de69d11b72b tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] 10.222.0.35 "GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368" status: 200 len: 1315 microversion: 2.1 time: 0.195013 Aug 07 04:54:27.162870 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 73/142] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:26 2021] GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368 => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:27.206128 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-5ef9089c-5943-4e8b-b41b-0911fd820580 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:27.206406 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-5ef9089c-5943-4e8b-b41b-0911fd820580 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:27.213159 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5ef9089c-5943-4e8b-b41b-0911fd820580 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:27.213856 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5ef9089c-5943-4e8b-b41b-0911fd820580 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:27.215938 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5ef9089c-5943-4e8b-b41b-0911fd820580 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:27.216527 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5ef9089c-5943-4e8b-b41b-0911fd820580 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:27.260512 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-e7d30106-7822-4883-8a2b-e0d586b34dc7 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:27.270251 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-e7d30106-7822-4883-8a2b-e0d586b34dc7 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:27.272983 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-e7d30106-7822-4883-8a2b-e0d586b34dc7 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:27.274243 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-e7d30106-7822-4883-8a2b-e0d586b34dc7 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1403 microversion: 2.20 time: 0.237345 Aug 07 04:54:27.275424 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 70/143] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:54:27 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1403 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:54:27.309904 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-01f32ff8-21d8-4f13-8b19-5b9337bed132 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:27.310506 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-01f32ff8-21d8-4f13-8b19-5b9337bed132 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:27.317443 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-01f32ff8-21d8-4f13-8b19-5b9337bed132 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:27.319148 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-01f32ff8-21d8-4f13-8b19-5b9337bed132 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:27.320155 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-01f32ff8-21d8-4f13-8b19-5b9337bed132 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:27.321251 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-01f32ff8-21d8-4f13-8b19-5b9337bed132 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:27.455564 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-5ef9089c-5943-4e8b-b41b-0911fd820580 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:27.466216 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-5ef9089c-5943-4e8b-b41b-0911fd820580 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b" status: 200 len: 1318 microversion: 2.1 time: 0.262509 Aug 07 04:54:27.467012 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 74/144] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:27 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b => generated 1318 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:27.550762 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-01f32ff8-21d8-4f13-8b19-5b9337bed132 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:27.558271 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-01f32ff8-21d8-4f13-8b19-5b9337bed132 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1322 microversion: 2.1 time: 0.253494 Aug 07 04:54:27.558845 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 71/145] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:27 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1322 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:54:27.570596 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [req-1396acbb-fb9c-4f3c-ac5e-d3fb4f3c9267 req-73297b64-e4d6-411c-8913-03ff04c44d97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebbb4a6b-6863-4efc-8e24-5073fcf14368", "name": "network-vif-plugged", "status": "completed", "tag": "1b5eb467-65ff-42a9-ae4a-da9f4bbed5d1"}]} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:54:27.572342 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 04:54:27.572342 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: warnings.warn(msg) Aug 07 04:54:27.580600 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-1396acbb-fb9c-4f3c-ac5e-d3fb4f3c9267 req-73297b64-e4d6-411c-8913-03ff04c44d97 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:27.581145 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-1396acbb-fb9c-4f3c-ac5e-d3fb4f3c9267 req-73297b64-e4d6-411c-8913-03ff04c44d97 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:27.600289 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.compute.server_external_events [req-1396acbb-fb9c-4f3c-ac5e-d3fb4f3c9267 req-73297b64-e4d6-411c-8913-03ff04c44d97 service nova] Creating event network-vif-plugged:1b5eb467-65ff-42a9-ae4a-da9f4bbed5d1 for instance ebbb4a6b-6863-4efc-8e24-5073fcf14368 on hv-cinder-80374 Aug 07 04:54:27.608985 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [req-1396acbb-fb9c-4f3c-ac5e-d3fb4f3c9267 req-73297b64-e4d6-411c-8913-03ff04c44d97 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137899 Aug 07 04:54:27.609756 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 75/146] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 04:54:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:54:28.178049 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-a7999d8b-8361-44bf-b530-d084ce520881 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:28.178658 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-a7999d8b-8361-44bf-b530-d084ce520881 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] [instance: ebbb4a6b-6863-4efc-8e24-5073fcf14368] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:28.184412 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a7999d8b-8361-44bf-b530-d084ce520881 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:28.184889 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a7999d8b-8361-44bf-b530-d084ce520881 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:28.185655 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a7999d8b-8361-44bf-b530-d084ce520881 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:28.186085 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a7999d8b-8361-44bf-b530-d084ce520881 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:28.291781 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-2bea9b1e-71d0-4f96-a648-4c936cdeacb7 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:28.293177 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-2bea9b1e-71d0-4f96-a648-4c936cdeacb7 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:28.299392 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2bea9b1e-71d0-4f96-a648-4c936cdeacb7 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:28.299848 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2bea9b1e-71d0-4f96-a648-4c936cdeacb7 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:28.300998 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2bea9b1e-71d0-4f96-a648-4c936cdeacb7 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:28.301454 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2bea9b1e-71d0-4f96-a648-4c936cdeacb7 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:28.305752 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-a7999d8b-8361-44bf-b530-d084ce520881 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa958efbec43feaf2a6341496d7eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbad771114b14d1c813e85f39291b826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:28.313259 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-a7999d8b-8361-44bf-b530-d084ce520881 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] 10.222.0.35 "GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368" status: 200 len: 1315 microversion: 2.1 time: 0.138798 Aug 07 04:54:28.313815 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 72/147] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:28 2021] GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368 => generated 1315 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:28.461308 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-2bea9b1e-71d0-4f96-a648-4c936cdeacb7 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:28.469899 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-2bea9b1e-71d0-4f96-a648-4c936cdeacb7 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:28.471406 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-2bea9b1e-71d0-4f96-a648-4c936cdeacb7 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:28.472613 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-2bea9b1e-71d0-4f96-a648-4c936cdeacb7 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1403 microversion: 2.20 time: 0.184915 Aug 07 04:54:28.473383 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 76/148] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:54:28 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1403 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 04:54:28.483319 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-fbc58dfe-cb11-4117-98db-6dd984533e52 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:28.483937 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-fbc58dfe-cb11-4117-98db-6dd984533e52 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:28.489853 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-fbc58dfe-cb11-4117-98db-6dd984533e52 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:28.490298 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-fbc58dfe-cb11-4117-98db-6dd984533e52 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:28.491068 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-fbc58dfe-cb11-4117-98db-6dd984533e52 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:28.491521 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-fbc58dfe-cb11-4117-98db-6dd984533e52 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:28.574299 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-261ddef9-ea82-41f1-841d-990aa4418ca1 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:28.574900 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-261ddef9-ea82-41f1-841d-990aa4418ca1 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:28.582863 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-261ddef9-ea82-41f1-841d-990aa4418ca1 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:28.583473 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-261ddef9-ea82-41f1-841d-990aa4418ca1 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:28.584416 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-261ddef9-ea82-41f1-841d-990aa4418ca1 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:28.585028 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-261ddef9-ea82-41f1-841d-990aa4418ca1 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:28.626713 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-fbc58dfe-cb11-4117-98db-6dd984533e52 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:28.634132 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-fbc58dfe-cb11-4117-98db-6dd984533e52 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b" status: 200 len: 1318 microversion: 2.1 time: 0.155392 Aug 07 04:54:28.634790 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 73/149] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:28 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:28.770269 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-261ddef9-ea82-41f1-841d-990aa4418ca1 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:28.778141 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-261ddef9-ea82-41f1-841d-990aa4418ca1 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1322 microversion: 2.1 time: 0.207714 Aug 07 04:54:28.778728 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 77/150] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:28 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:54:29.330178 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-f16b068e-c81f-4df4-8290-58343fa62993 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:29.330782 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-f16b068e-c81f-4df4-8290-58343fa62993 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] [instance: ebbb4a6b-6863-4efc-8e24-5073fcf14368] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:29.337082 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f16b068e-c81f-4df4-8290-58343fa62993 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:29.337699 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f16b068e-c81f-4df4-8290-58343fa62993 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:29.339035 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f16b068e-c81f-4df4-8290-58343fa62993 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:29.339378 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f16b068e-c81f-4df4-8290-58343fa62993 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:29.468759 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-f16b068e-c81f-4df4-8290-58343fa62993 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa958efbec43feaf2a6341496d7eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbad771114b14d1c813e85f39291b826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:29.476851 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-f16b068e-c81f-4df4-8290-58343fa62993 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] 10.222.0.35 "GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368" status: 200 len: 1315 microversion: 2.1 time: 0.150268 Aug 07 04:54:29.477895 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 74/151] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:29 2021] GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:29.491080 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-d0f2bf04-8af9-4a2c-8a0a-7f5d7d9ff8e1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:29.491694 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-d0f2bf04-8af9-4a2c-8a0a-7f5d7d9ff8e1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:29.497781 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d0f2bf04-8af9-4a2c-8a0a-7f5d7d9ff8e1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:29.498222 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d0f2bf04-8af9-4a2c-8a0a-7f5d7d9ff8e1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:29.498984 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d0f2bf04-8af9-4a2c-8a0a-7f5d7d9ff8e1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:29.499414 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d0f2bf04-8af9-4a2c-8a0a-7f5d7d9ff8e1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:29.622900 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-d0f2bf04-8af9-4a2c-8a0a-7f5d7d9ff8e1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:29.631797 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-d0f2bf04-8af9-4a2c-8a0a-7f5d7d9ff8e1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:29.633490 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-d0f2bf04-8af9-4a2c-8a0a-7f5d7d9ff8e1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:29.634580 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-d0f2bf04-8af9-4a2c-8a0a-7f5d7d9ff8e1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1403 microversion: 2.20 time: 0.147150 Aug 07 04:54:29.644838 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 78/152] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:54:29 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1403 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:54:29.651247 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-8f1f3a33-923f-479e-b0ee-a0513827802d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:29.651791 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-8f1f3a33-923f-479e-b0ee-a0513827802d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:29.657827 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8f1f3a33-923f-479e-b0ee-a0513827802d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:29.658262 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8f1f3a33-923f-479e-b0ee-a0513827802d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:29.659032 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8f1f3a33-923f-479e-b0ee-a0513827802d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:29.659429 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8f1f3a33-923f-479e-b0ee-a0513827802d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:29.781884 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-8f1f3a33-923f-479e-b0ee-a0513827802d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:29.789264 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-8f1f3a33-923f-479e-b0ee-a0513827802d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b" status: 200 len: 1318 microversion: 2.1 time: 0.141534 Aug 07 04:54:29.789824 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 75/153] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:29 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b => generated 1318 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:29.803347 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-764208e2-e91f-4b37-ac3b-1177384e1629 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:29.804041 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-764208e2-e91f-4b37-ac3b-1177384e1629 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:29.811223 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-764208e2-e91f-4b37-ac3b-1177384e1629 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:29.811662 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-764208e2-e91f-4b37-ac3b-1177384e1629 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:29.812525 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-764208e2-e91f-4b37-ac3b-1177384e1629 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:29.812991 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-764208e2-e91f-4b37-ac3b-1177384e1629 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:29.939949 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-764208e2-e91f-4b37-ac3b-1177384e1629 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:29.947373 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-764208e2-e91f-4b37-ac3b-1177384e1629 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1322 microversion: 2.1 time: 0.155763 Aug 07 04:54:29.948030 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 79/154] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:29 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:54:30.493598 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-f51b2214-e71a-456a-8210-e846e04c04ff tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:30.494342 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-f51b2214-e71a-456a-8210-e846e04c04ff tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] [instance: ebbb4a6b-6863-4efc-8e24-5073fcf14368] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:30.500302 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f51b2214-e71a-456a-8210-e846e04c04ff tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:30.500758 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f51b2214-e71a-456a-8210-e846e04c04ff tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:30.501560 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f51b2214-e71a-456a-8210-e846e04c04ff tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:30.501993 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f51b2214-e71a-456a-8210-e846e04c04ff tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:30.646431 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-f51b2214-e71a-456a-8210-e846e04c04ff tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa958efbec43feaf2a6341496d7eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbad771114b14d1c813e85f39291b826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:30.655967 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-33d71188-3934-429f-b116-05b7421bc559 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:30.657310 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-33d71188-3934-429f-b116-05b7421bc559 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:30.659366 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-f51b2214-e71a-456a-8210-e846e04c04ff tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] 10.222.0.35 "GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368" status: 200 len: 1315 microversion: 2.1 time: 0.166689 Aug 07 04:54:30.660114 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 76/155] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:30 2021] GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:30.676438 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-33d71188-3934-429f-b116-05b7421bc559 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:30.677501 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-33d71188-3934-429f-b116-05b7421bc559 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:30.678515 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-33d71188-3934-429f-b116-05b7421bc559 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:30.679138 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-33d71188-3934-429f-b116-05b7421bc559 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:30.810322 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-8da4f5f5-e911-4d0d-9a5f-90a0af273e38 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:30.811776 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-8da4f5f5-e911-4d0d-9a5f-90a0af273e38 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:30.821121 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8da4f5f5-e911-4d0d-9a5f-90a0af273e38 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:30.822141 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8da4f5f5-e911-4d0d-9a5f-90a0af273e38 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:30.823982 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8da4f5f5-e911-4d0d-9a5f-90a0af273e38 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:30.825718 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8da4f5f5-e911-4d0d-9a5f-90a0af273e38 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:30.891207 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-33d71188-3934-429f-b116-05b7421bc559 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:30.907530 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-33d71188-3934-429f-b116-05b7421bc559 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:30.910306 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-33d71188-3934-429f-b116-05b7421bc559 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:30.911623 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-33d71188-3934-429f-b116-05b7421bc559 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1403 microversion: 2.20 time: 0.262975 Aug 07 04:54:30.912750 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 80/156] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:54:30 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1403 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 04:54:30.964215 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-dfc4e9f1-d967-434f-8ad8-5a17ea100593 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:30.965141 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-dfc4e9f1-d967-434f-8ad8-5a17ea100593 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:30.975255 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-dfc4e9f1-d967-434f-8ad8-5a17ea100593 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:30.977601 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-dfc4e9f1-d967-434f-8ad8-5a17ea100593 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:30.977885 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-8da4f5f5-e911-4d0d-9a5f-90a0af273e38 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:30.978763 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-dfc4e9f1-d967-434f-8ad8-5a17ea100593 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:30.979340 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-dfc4e9f1-d967-434f-8ad8-5a17ea100593 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:30.994677 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-8da4f5f5-e911-4d0d-9a5f-90a0af273e38 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b" status: 200 len: 1318 microversion: 2.1 time: 0.190781 Aug 07 04:54:30.995673 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 77/157] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:30 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:54:31.189083 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-dfc4e9f1-d967-434f-8ad8-5a17ea100593 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:31.197169 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-dfc4e9f1-d967-434f-8ad8-5a17ea100593 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1322 microversion: 2.1 time: 0.237316 Aug 07 04:54:31.197800 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 81/158] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:30 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1322 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:54:31.676920 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-d12f39cf-8ef0-4d77-b2ed-7ed7f86ecdba tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:31.677533 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-d12f39cf-8ef0-4d77-b2ed-7ed7f86ecdba tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] [instance: ebbb4a6b-6863-4efc-8e24-5073fcf14368] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:31.683364 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d12f39cf-8ef0-4d77-b2ed-7ed7f86ecdba tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:31.683803 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d12f39cf-8ef0-4d77-b2ed-7ed7f86ecdba tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:31.686475 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d12f39cf-8ef0-4d77-b2ed-7ed7f86ecdba tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:31.686909 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d12f39cf-8ef0-4d77-b2ed-7ed7f86ecdba tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:31.813170 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-d12f39cf-8ef0-4d77-b2ed-7ed7f86ecdba tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa958efbec43feaf2a6341496d7eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbad771114b14d1c813e85f39291b826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:31.820462 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-d12f39cf-8ef0-4d77-b2ed-7ed7f86ecdba tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] 10.222.0.35 "GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368" status: 200 len: 1315 microversion: 2.1 time: 0.147194 Aug 07 04:54:31.821049 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 78/159] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:31 2021] GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:31.930084 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-bde2faa2-7c5d-406e-8be1-e40adae78bad tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:31.930682 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-bde2faa2-7c5d-406e-8be1-e40adae78bad tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:31.937289 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-bde2faa2-7c5d-406e-8be1-e40adae78bad tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:31.937752 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-bde2faa2-7c5d-406e-8be1-e40adae78bad tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:31.938505 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-bde2faa2-7c5d-406e-8be1-e40adae78bad tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:31.938933 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-bde2faa2-7c5d-406e-8be1-e40adae78bad tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:32.011410 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-1685c5fb-37bf-49b1-b020-16ef936e2731 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:32.012014 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-1685c5fb-37bf-49b1-b020-16ef936e2731 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:32.018659 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1685c5fb-37bf-49b1-b020-16ef936e2731 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:32.019155 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1685c5fb-37bf-49b1-b020-16ef936e2731 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:32.019925 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1685c5fb-37bf-49b1-b020-16ef936e2731 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:32.020353 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1685c5fb-37bf-49b1-b020-16ef936e2731 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:32.071937 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-bde2faa2-7c5d-406e-8be1-e40adae78bad tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:32.080325 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-bde2faa2-7c5d-406e-8be1-e40adae78bad tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:32.082113 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-bde2faa2-7c5d-406e-8be1-e40adae78bad tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:32.083139 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-bde2faa2-7c5d-406e-8be1-e40adae78bad tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1403 microversion: 2.20 time: 0.156746 Aug 07 04:54:32.083853 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 82/160] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:54:31 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1403 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:54:32.149385 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-1685c5fb-37bf-49b1-b020-16ef936e2731 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:32.157275 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-1685c5fb-37bf-49b1-b020-16ef936e2731 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b" status: 200 len: 1318 microversion: 2.1 time: 0.149564 Aug 07 04:54:32.157841 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 79/161] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:32 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:54:32.214302 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-f3d5e43c-5340-48d7-bf56-a71a54337e14 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:32.214908 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-f3d5e43c-5340-48d7-bf56-a71a54337e14 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:32.221861 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f3d5e43c-5340-48d7-bf56-a71a54337e14 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:32.222296 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f3d5e43c-5340-48d7-bf56-a71a54337e14 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:32.223072 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f3d5e43c-5340-48d7-bf56-a71a54337e14 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:32.223496 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f3d5e43c-5340-48d7-bf56-a71a54337e14 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:32.347734 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-f3d5e43c-5340-48d7-bf56-a71a54337e14 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:32.355216 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-f3d5e43c-5340-48d7-bf56-a71a54337e14 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1322 microversion: 2.1 time: 0.144603 Aug 07 04:54:32.355772 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 83/162] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:32 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1322 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:32.838160 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-4e84fbaf-0167-4f31-bef8-dd9010ab1d81 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:32.838784 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-4e84fbaf-0167-4f31-bef8-dd9010ab1d81 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] [instance: ebbb4a6b-6863-4efc-8e24-5073fcf14368] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:32.845257 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4e84fbaf-0167-4f31-bef8-dd9010ab1d81 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:32.845701 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4e84fbaf-0167-4f31-bef8-dd9010ab1d81 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:32.846461 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4e84fbaf-0167-4f31-bef8-dd9010ab1d81 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:32.846893 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4e84fbaf-0167-4f31-bef8-dd9010ab1d81 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:32.967373 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-4e84fbaf-0167-4f31-bef8-dd9010ab1d81 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa958efbec43feaf2a6341496d7eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbad771114b14d1c813e85f39291b826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:32.974766 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-4e84fbaf-0167-4f31-bef8-dd9010ab1d81 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] 10.222.0.35 "GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368" status: 200 len: 1315 microversion: 2.1 time: 0.140353 Aug 07 04:54:32.975673 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 80/163] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:32 2021] GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368 => generated 1315 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:33.101581 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-df0bdd10-431b-4c66-ba56-d135bb80d152 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:33.102189 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-df0bdd10-431b-4c66-ba56-d135bb80d152 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:33.108006 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-df0bdd10-431b-4c66-ba56-d135bb80d152 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:33.108447 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-df0bdd10-431b-4c66-ba56-d135bb80d152 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:33.109243 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-df0bdd10-431b-4c66-ba56-d135bb80d152 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:33.109676 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-df0bdd10-431b-4c66-ba56-d135bb80d152 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:33.172960 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-da8e8a32-2cc2-4a3d-be99-bfbab0feeb1b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:33.173629 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-da8e8a32-2cc2-4a3d-be99-bfbab0feeb1b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:33.187467 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-da8e8a32-2cc2-4a3d-be99-bfbab0feeb1b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:33.187467 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-da8e8a32-2cc2-4a3d-be99-bfbab0feeb1b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:33.187467 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-da8e8a32-2cc2-4a3d-be99-bfbab0feeb1b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:33.187467 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-da8e8a32-2cc2-4a3d-be99-bfbab0feeb1b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:33.319979 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-df0bdd10-431b-4c66-ba56-d135bb80d152 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:33.333986 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-df0bdd10-431b-4c66-ba56-d135bb80d152 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:33.336107 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-df0bdd10-431b-4c66-ba56-d135bb80d152 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:33.337233 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-df0bdd10-431b-4c66-ba56-d135bb80d152 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1403 microversion: 2.20 time: 0.239460 Aug 07 04:54:33.337772 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 84/164] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:54:33 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1403 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:54:33.371701 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-65f7fe52-a722-4161-93d1-fc1c6614a940 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:33.372771 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-65f7fe52-a722-4161-93d1-fc1c6614a940 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:33.375569 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-da8e8a32-2cc2-4a3d-be99-bfbab0feeb1b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:33.378832 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-65f7fe52-a722-4161-93d1-fc1c6614a940 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:33.379415 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-65f7fe52-a722-4161-93d1-fc1c6614a940 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:33.380303 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-65f7fe52-a722-4161-93d1-fc1c6614a940 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:33.380973 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-65f7fe52-a722-4161-93d1-fc1c6614a940 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:33.382813 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-da8e8a32-2cc2-4a3d-be99-bfbab0feeb1b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b" status: 200 len: 1318 microversion: 2.1 time: 0.213774 Aug 07 04:54:33.383369 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 81/165] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:33 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:33.508807 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-65f7fe52-a722-4161-93d1-fc1c6614a940 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:33.517201 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-65f7fe52-a722-4161-93d1-fc1c6614a940 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1322 microversion: 2.1 time: 0.149306 Aug 07 04:54:33.517803 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 85/166] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:33 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:54:33.991530 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-9f2d5a60-bcec-440e-bb3b-08a306f62565 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:33.992180 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-9f2d5a60-bcec-440e-bb3b-08a306f62565 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] [instance: ebbb4a6b-6863-4efc-8e24-5073fcf14368] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:33.998511 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9f2d5a60-bcec-440e-bb3b-08a306f62565 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:33.998962 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9f2d5a60-bcec-440e-bb3b-08a306f62565 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:33.999953 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9f2d5a60-bcec-440e-bb3b-08a306f62565 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:34.000569 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9f2d5a60-bcec-440e-bb3b-08a306f62565 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:34.127955 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-9f2d5a60-bcec-440e-bb3b-08a306f62565 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa958efbec43feaf2a6341496d7eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbad771114b14d1c813e85f39291b826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:34.135472 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-9f2d5a60-bcec-440e-bb3b-08a306f62565 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] 10.222.0.35 "GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368" status: 200 len: 1315 microversion: 2.1 time: 0.147557 Aug 07 04:54:34.136251 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 82/167] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:33 2021] GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:34.358171 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-0ec9eea5-ffa2-448f-aa80-cb4df5e8f911 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:34.359756 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-0ec9eea5-ffa2-448f-aa80-cb4df5e8f911 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:34.366077 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0ec9eea5-ffa2-448f-aa80-cb4df5e8f911 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:34.366782 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0ec9eea5-ffa2-448f-aa80-cb4df5e8f911 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:34.367585 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0ec9eea5-ffa2-448f-aa80-cb4df5e8f911 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:34.368025 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0ec9eea5-ffa2-448f-aa80-cb4df5e8f911 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:34.401866 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-96b80698-725f-4476-b6cb-a0f6f16f21fa tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:34.402364 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-96b80698-725f-4476-b6cb-a0f6f16f21fa tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:34.426829 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-96b80698-725f-4476-b6cb-a0f6f16f21fa tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:34.426829 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-96b80698-725f-4476-b6cb-a0f6f16f21fa tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:34.427120 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-96b80698-725f-4476-b6cb-a0f6f16f21fa tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:34.427374 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-96b80698-725f-4476-b6cb-a0f6f16f21fa tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:34.567870 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-96b80698-725f-4476-b6cb-a0f6f16f21fa tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:34.575549 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-96b80698-725f-4476-b6cb-a0f6f16f21fa tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b" status: 200 len: 1318 microversion: 2.1 time: 0.179130 Aug 07 04:54:34.576923 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 83/168] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:34 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:54:34.583528 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-c158a94f-5fd8-45bb-8d07-becf1405cbcc tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:34.584526 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-c158a94f-5fd8-45bb-8d07-becf1405cbcc tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:34.588240 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-0ec9eea5-ffa2-448f-aa80-cb4df5e8f911 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:34.592655 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c158a94f-5fd8-45bb-8d07-becf1405cbcc tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:34.593518 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c158a94f-5fd8-45bb-8d07-becf1405cbcc tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:34.594810 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c158a94f-5fd8-45bb-8d07-becf1405cbcc tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:34.595391 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c158a94f-5fd8-45bb-8d07-becf1405cbcc tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:34.598224 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-0ec9eea5-ffa2-448f-aa80-cb4df5e8f911 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:34.599823 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-0ec9eea5-ffa2-448f-aa80-cb4df5e8f911 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:34.601340 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-0ec9eea5-ffa2-448f-aa80-cb4df5e8f911 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1403 microversion: 2.20 time: 0.248287 Aug 07 04:54:34.601992 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 86/169] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:54:34 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1403 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:54:34.755441 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-c158a94f-5fd8-45bb-8d07-becf1405cbcc tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:34.763713 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-c158a94f-5fd8-45bb-8d07-becf1405cbcc tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1322 microversion: 2.1 time: 0.185367 Aug 07 04:54:34.764361 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 84/170] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:34 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:35.114770 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [req-a3f7b242-1b19-40f9-a795-45207ad8256d req-b29bbd9f-6d80-4b84-bee1-6c79e6ee2b22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7660d04d-3aad-49e0-b8a5-12820fcb4d66", "name": "network-vif-plugged", "status": "completed", "tag": "8385bf57-9f35-4380-8238-83874f21430a"}]} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:54:35.117041 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 04:54:35.117041 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: warnings.warn(msg) Aug 07 04:54:35.128647 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-a3f7b242-1b19-40f9-a795-45207ad8256d req-b29bbd9f-6d80-4b84-bee1-6c79e6ee2b22 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:35.129747 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-a3f7b242-1b19-40f9-a795-45207ad8256d req-b29bbd9f-6d80-4b84-bee1-6c79e6ee2b22 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:35.145091 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.compute.server_external_events [req-a3f7b242-1b19-40f9-a795-45207ad8256d req-b29bbd9f-6d80-4b84-bee1-6c79e6ee2b22 service nova] Creating event network-vif-plugged:8385bf57-9f35-4380-8238-83874f21430a for instance 7660d04d-3aad-49e0-b8a5-12820fcb4d66 on hv-cinder-80374 Aug 07 04:54:35.154314 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-675544a1-bd19-4297-bd30-d83b465333bc tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:35.155038 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-675544a1-bd19-4297-bd30-d83b465333bc tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] [instance: ebbb4a6b-6863-4efc-8e24-5073fcf14368] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:35.155545 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [req-a3f7b242-1b19-40f9-a795-45207ad8256d req-b29bbd9f-6d80-4b84-bee1-6c79e6ee2b22 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043737 Aug 07 04:54:35.156419 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 87/171] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 04:54:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:54:35.161556 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-675544a1-bd19-4297-bd30-d83b465333bc tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:35.162226 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-675544a1-bd19-4297-bd30-d83b465333bc tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:35.163179 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-675544a1-bd19-4297-bd30-d83b465333bc tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:35.163870 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-675544a1-bd19-4297-bd30-d83b465333bc tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:35.377317 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-675544a1-bd19-4297-bd30-d83b465333bc tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa958efbec43feaf2a6341496d7eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbad771114b14d1c813e85f39291b826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:35.387501 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-675544a1-bd19-4297-bd30-d83b465333bc tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] 10.222.0.35 "GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368" status: 200 len: 1501 microversion: 2.1 time: 0.236280 Aug 07 04:54:35.412482 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 85/172] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:35 2021] GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368 => generated 1501 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:54:35.593144 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-f590eef7-09f5-483b-8c73-2955f551b520 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:35.593892 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-f590eef7-09f5-483b-8c73-2955f551b520 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:35.607247 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f590eef7-09f5-483b-8c73-2955f551b520 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:35.608311 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f590eef7-09f5-483b-8c73-2955f551b520 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:35.609356 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f590eef7-09f5-483b-8c73-2955f551b520 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:35.610193 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f590eef7-09f5-483b-8c73-2955f551b520 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:35.622532 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-7f3c6f61-cfb0-463b-a2ee-a0f6288014c6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:35.623150 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-7f3c6f61-cfb0-463b-a2ee-a0f6288014c6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:35.641943 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7f3c6f61-cfb0-463b-a2ee-a0f6288014c6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:35.642564 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7f3c6f61-cfb0-463b-a2ee-a0f6288014c6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:35.643527 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7f3c6f61-cfb0-463b-a2ee-a0f6288014c6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:35.645222 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7f3c6f61-cfb0-463b-a2ee-a0f6288014c6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:35.830853 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-7f3c6f61-cfb0-463b-a2ee-a0f6288014c6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:35.838101 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-f590eef7-09f5-483b-8c73-2955f551b520 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:35.844571 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-7f3c6f61-cfb0-463b-a2ee-a0f6288014c6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:35.846953 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-f590eef7-09f5-483b-8c73-2955f551b520 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b" status: 200 len: 1318 microversion: 2.1 time: 0.258953 Aug 07 04:54:35.848262 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-7f3c6f61-cfb0-463b-a2ee-a0f6288014c6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:35.850355 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 88/173] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:35 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b => generated 1318 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:35.851193 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-7f3c6f61-cfb0-463b-a2ee-a0f6288014c6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1403 microversion: 2.20 time: 0.234164 Aug 07 04:54:35.853088 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 86/174] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:54:35 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1403 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:54:35.869968 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-cd456b3b-4d0b-4171-9d45-79aa92954856 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:35.870798 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-cd456b3b-4d0b-4171-9d45-79aa92954856 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:35.878224 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-cd456b3b-4d0b-4171-9d45-79aa92954856 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:35.878966 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-cd456b3b-4d0b-4171-9d45-79aa92954856 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:35.879938 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-cd456b3b-4d0b-4171-9d45-79aa92954856 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:35.880517 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-cd456b3b-4d0b-4171-9d45-79aa92954856 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:36.092950 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-cd456b3b-4d0b-4171-9d45-79aa92954856 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:36.101872 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-cd456b3b-4d0b-4171-9d45-79aa92954856 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1322 microversion: 2.1 time: 0.250336 Aug 07 04:54:36.102642 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 89/175] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:35 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1322 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:36.865803 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-bd788c00-201e-43fb-9814-194d751c2894 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:36.866403 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-bd788c00-201e-43fb-9814-194d751c2894 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:36.873818 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-bd788c00-201e-43fb-9814-194d751c2894 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:36.874738 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-bd788c00-201e-43fb-9814-194d751c2894 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:36.876318 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-bd788c00-201e-43fb-9814-194d751c2894 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:36.877017 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-71e39af4-2c96-4194-b88d-895c26831cde tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:36.877430 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-bd788c00-201e-43fb-9814-194d751c2894 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:36.877554 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-71e39af4-2c96-4194-b88d-895c26831cde tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:36.885331 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-71e39af4-2c96-4194-b88d-895c26831cde tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:36.885971 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-71e39af4-2c96-4194-b88d-895c26831cde tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:36.886917 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-71e39af4-2c96-4194-b88d-895c26831cde tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:36.888083 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-71e39af4-2c96-4194-b88d-895c26831cde tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:37.024376 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-bd788c00-201e-43fb-9814-194d751c2894 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:37.032942 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-bd788c00-201e-43fb-9814-194d751c2894 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b" status: 200 len: 1318 microversion: 2.1 time: 0.171235 Aug 07 04:54:37.034616 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 87/176] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:36 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:37.052150 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-71e39af4-2c96-4194-b88d-895c26831cde tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:37.061437 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-71e39af4-2c96-4194-b88d-895c26831cde tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:37.062919 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-71e39af4-2c96-4194-b88d-895c26831cde tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:37.063979 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-71e39af4-2c96-4194-b88d-895c26831cde tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1403 microversion: 2.20 time: 0.190631 Aug 07 04:54:37.065015 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 90/177] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:54:36 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1403 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:54:37.119224 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-1a1e917e-21bf-469f-a746-7a8fceb4c037 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:37.119844 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-1a1e917e-21bf-469f-a746-7a8fceb4c037 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:37.126987 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1a1e917e-21bf-469f-a746-7a8fceb4c037 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:37.127522 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1a1e917e-21bf-469f-a746-7a8fceb4c037 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:37.128368 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1a1e917e-21bf-469f-a746-7a8fceb4c037 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:37.128982 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1a1e917e-21bf-469f-a746-7a8fceb4c037 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:37.187767 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [req-bee51677-06df-4d8f-bfbd-28628bf620a3 req-70d904aa-8d3f-4419-bacb-c10509a55820 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "431857b6-a453-44f0-829c-00ed610d5fc2", "name": "network-vif-plugged", "status": "completed", "tag": "6a0264c8-c45c-4fec-b570-31fbf0131107"}]} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:54:37.189979 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 04:54:37.189979 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: warnings.warn(msg) Aug 07 04:54:37.198300 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-bee51677-06df-4d8f-bfbd-28628bf620a3 req-70d904aa-8d3f-4419-bacb-c10509a55820 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:37.198813 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-bee51677-06df-4d8f-bfbd-28628bf620a3 req-70d904aa-8d3f-4419-bacb-c10509a55820 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:37.211616 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.compute.server_external_events [req-bee51677-06df-4d8f-bfbd-28628bf620a3 req-70d904aa-8d3f-4419-bacb-c10509a55820 service nova] Creating event network-vif-plugged:6a0264c8-c45c-4fec-b570-31fbf0131107 for instance 431857b6-a453-44f0-829c-00ed610d5fc2 on hv-cinder-80374 Aug 07 04:54:37.218417 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [req-bee51677-06df-4d8f-bfbd-28628bf620a3 req-70d904aa-8d3f-4419-bacb-c10509a55820 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034319 Aug 07 04:54:37.224362 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 91/178] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 04:54:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 04:54:37.267448 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-1a1e917e-21bf-469f-a746-7a8fceb4c037 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:37.276777 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-1a1e917e-21bf-469f-a746-7a8fceb4c037 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1322 microversion: 2.1 time: 0.159227 Aug 07 04:54:37.276777 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 88/179] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:37 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:38.050790 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-6a25ae55-0946-41e4-b520-f012103824a8 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:38.051474 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-6a25ae55-0946-41e4-b520-f012103824a8 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:38.057655 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6a25ae55-0946-41e4-b520-f012103824a8 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:38.058092 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6a25ae55-0946-41e4-b520-f012103824a8 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:38.061779 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6a25ae55-0946-41e4-b520-f012103824a8 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:38.062266 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6a25ae55-0946-41e4-b520-f012103824a8 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:38.081851 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-354d0e34-c5c7-4deb-988c-5311312e092b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:38.082455 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-354d0e34-c5c7-4deb-988c-5311312e092b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:38.088432 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-354d0e34-c5c7-4deb-988c-5311312e092b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:38.088909 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-354d0e34-c5c7-4deb-988c-5311312e092b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:38.089843 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-354d0e34-c5c7-4deb-988c-5311312e092b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:38.090966 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-354d0e34-c5c7-4deb-988c-5311312e092b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:38.187798 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-6a25ae55-0946-41e4-b520-f012103824a8 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:38.194990 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-6a25ae55-0946-41e4-b520-f012103824a8 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b" status: 200 len: 1318 microversion: 2.1 time: 0.148156 Aug 07 04:54:38.195593 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 92/180] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:38 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:38.230457 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-354d0e34-c5c7-4deb-988c-5311312e092b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:38.238301 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-354d0e34-c5c7-4deb-988c-5311312e092b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:38.239783 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-354d0e34-c5c7-4deb-988c-5311312e092b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:38.240886 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-354d0e34-c5c7-4deb-988c-5311312e092b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1403 microversion: 2.20 time: 0.162964 Aug 07 04:54:38.241436 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 89/181] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:54:38 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1403 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:54:38.290987 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-85baf091-eb5a-4253-a899-3318b6149010 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:38.291589 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-85baf091-eb5a-4253-a899-3318b6149010 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:38.297674 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-85baf091-eb5a-4253-a899-3318b6149010 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:38.298110 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-85baf091-eb5a-4253-a899-3318b6149010 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:38.298886 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-85baf091-eb5a-4253-a899-3318b6149010 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:38.299292 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-85baf091-eb5a-4253-a899-3318b6149010 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:38.428523 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-85baf091-eb5a-4253-a899-3318b6149010 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:38.436731 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-85baf091-eb5a-4253-a899-3318b6149010 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1322 microversion: 2.1 time: 0.149369 Aug 07 04:54:38.437344 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 93/182] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:38 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:39.212729 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-07d4624b-ad44-41b0-84df-abb04f68a7cc tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:39.213359 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-07d4624b-ad44-41b0-84df-abb04f68a7cc tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:39.220459 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-07d4624b-ad44-41b0-84df-abb04f68a7cc tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:39.220927 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-07d4624b-ad44-41b0-84df-abb04f68a7cc tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:39.221750 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-07d4624b-ad44-41b0-84df-abb04f68a7cc tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:39.222193 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-07d4624b-ad44-41b0-84df-abb04f68a7cc tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:39.235959 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [req-272d39d9-f427-4faf-9171-0e61c7409ba8 req-d2b5c475-6f84-48f8-b479-a1345832e1ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90d6eef5-1c82-472b-adfb-aeaa1e93d502", "name": "network-vif-plugged", "status": "completed", "tag": "bd78445c-a49c-49cb-abaf-0ddaf6492e2c"}]} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:54:39.238387 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 04:54:39.238387 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: warnings.warn(msg) Aug 07 04:54:39.248287 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-272d39d9-f427-4faf-9171-0e61c7409ba8 req-d2b5c475-6f84-48f8-b479-a1345832e1ca service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:39.249040 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-272d39d9-f427-4faf-9171-0e61c7409ba8 req-d2b5c475-6f84-48f8-b479-a1345832e1ca service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:39.262091 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.compute.server_external_events [req-272d39d9-f427-4faf-9171-0e61c7409ba8 req-d2b5c475-6f84-48f8-b479-a1345832e1ca service nova] Creating event network-vif-plugged:bd78445c-a49c-49cb-abaf-0ddaf6492e2c for instance 90d6eef5-1c82-472b-adfb-aeaa1e93d502 on hv-cinder-80374 Aug 07 04:54:39.268179 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [req-272d39d9-f427-4faf-9171-0e61c7409ba8 req-d2b5c475-6f84-48f8-b479-a1345832e1ca service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036423 Aug 07 04:54:39.269125 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 94/183] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 04:54:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 04:54:39.276383 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-6deca446-beb5-4b5b-acdb-7fba295da3a2 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:39.277388 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-6deca446-beb5-4b5b-acdb-7fba295da3a2 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:39.287765 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6deca446-beb5-4b5b-acdb-7fba295da3a2 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:39.288642 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6deca446-beb5-4b5b-acdb-7fba295da3a2 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:39.289990 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6deca446-beb5-4b5b-acdb-7fba295da3a2 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:39.290633 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6deca446-beb5-4b5b-acdb-7fba295da3a2 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:39.409480 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-07d4624b-ad44-41b0-84df-abb04f68a7cc tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:39.421569 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-07d4624b-ad44-41b0-84df-abb04f68a7cc tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b" status: 200 len: 1318 microversion: 2.1 time: 0.212453 Aug 07 04:54:39.422294 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 90/184] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:39 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b => generated 1318 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:39.439288 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-6deca446-beb5-4b5b-acdb-7fba295da3a2 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:39.447750 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-6deca446-beb5-4b5b-acdb-7fba295da3a2 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:39.450024 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-6deca446-beb5-4b5b-acdb-7fba295da3a2 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:39.451667 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-6deca446-beb5-4b5b-acdb-7fba295da3a2 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1403 microversion: 2.20 time: 0.181197 Aug 07 04:54:39.452322 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 95/185] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:54:39 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1403 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:54:39.460971 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-24c3250c-9031-488b-b6eb-e9aa7da2d0b2 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:39.460971 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-24c3250c-9031-488b-b6eb-e9aa7da2d0b2 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:39.462664 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-24c3250c-9031-488b-b6eb-e9aa7da2d0b2 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:39.462664 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-24c3250c-9031-488b-b6eb-e9aa7da2d0b2 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:39.462939 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-24c3250c-9031-488b-b6eb-e9aa7da2d0b2 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:39.463542 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-24c3250c-9031-488b-b6eb-e9aa7da2d0b2 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:39.620703 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-24c3250c-9031-488b-b6eb-e9aa7da2d0b2 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:39.628609 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-24c3250c-9031-488b-b6eb-e9aa7da2d0b2 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1322 microversion: 2.1 time: 0.179117 Aug 07 04:54:39.629248 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 91/186] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:39 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:54:40.099516 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-8953a018-4928-483c-a10f-5869d48e2477 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d459b6f-5077-4266-b6a4-4c7cbd56e3d7"}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:54:40.101116 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-8953a018-4928-483c-a10f-5869d48e2477 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] [instance: ebbb4a6b-6863-4efc-8e24-5073fcf14368] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:40.108217 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8953a018-4928-483c-a10f-5869d48e2477 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:40.108574 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8953a018-4928-483c-a10f-5869d48e2477 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:40.109365 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8953a018-4928-483c-a10f-5869d48e2477 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:40.109789 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8953a018-4928-483c-a10f-5869d48e2477 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:40.438546 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-5bd758f0-70ee-4bef-9f1d-074af8348a9b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:40.439249 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-5bd758f0-70ee-4bef-9f1d-074af8348a9b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:40.444924 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5bd758f0-70ee-4bef-9f1d-074af8348a9b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:40.445367 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5bd758f0-70ee-4bef-9f1d-074af8348a9b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:40.446116 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5bd758f0-70ee-4bef-9f1d-074af8348a9b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:40.446546 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5bd758f0-70ee-4bef-9f1d-074af8348a9b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:40.594969 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-5bd758f0-70ee-4bef-9f1d-074af8348a9b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:40.607973 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-5bd758f0-70ee-4bef-9f1d-074af8348a9b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b" status: 200 len: 1318 microversion: 2.1 time: 0.173766 Aug 07 04:54:40.618533 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 92/187] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:40 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:54:40.624346 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-b0e155d3-90b7-4c4d-8bb5-27ea306c5a2b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:40.624950 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-b0e155d3-90b7-4c4d-8bb5-27ea306c5a2b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:40.631105 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-8953a018-4928-483c-a10f-5869d48e2477 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] 10.222.0.35 "POST /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.535119 Aug 07 04:54:40.631615 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b0e155d3-90b7-4c4d-8bb5-27ea306c5a2b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:40.632007 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b0e155d3-90b7-4c4d-8bb5-27ea306c5a2b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:40.632662 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 96/188] 10.222.0.35 () {60 vars in 1323 bytes} [Sat Aug 7 04:54:40 2021] POST /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368/os-volume_attachments => generated 194 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:54:40.633241 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b0e155d3-90b7-4c4d-8bb5-27ea306c5a2b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:40.633895 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b0e155d3-90b7-4c4d-8bb5-27ea306c5a2b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:40.644717 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-2fd24606-6f57-4132-b09f-2e4b241e8e1b tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:40.645641 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-2fd24606-6f57-4132-b09f-2e4b241e8e1b tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:40.663264 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2fd24606-6f57-4132-b09f-2e4b241e8e1b tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:40.663264 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2fd24606-6f57-4132-b09f-2e4b241e8e1b tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:40.663264 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2fd24606-6f57-4132-b09f-2e4b241e8e1b tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:40.663264 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2fd24606-6f57-4132-b09f-2e4b241e8e1b tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:40.815597 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-b0e155d3-90b7-4c4d-8bb5-27ea306c5a2b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:40.828166 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-b0e155d3-90b7-4c4d-8bb5-27ea306c5a2b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:40.831574 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-2fd24606-6f57-4132-b09f-2e4b241e8e1b tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:40.852220 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-b0e155d3-90b7-4c4d-8bb5-27ea306c5a2b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:40.853415 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-b0e155d3-90b7-4c4d-8bb5-27ea306c5a2b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1403 microversion: 2.20 time: 0.233690 Aug 07 04:54:40.853974 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-2fd24606-6f57-4132-b09f-2e4b241e8e1b tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1322 microversion: 2.1 time: 0.200813 Aug 07 04:54:40.855016 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 97/189] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:40 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:54:40.857294 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 93/190] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:54:40 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1403 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:54:41.288709 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [req-1d85b543-5dd2-466f-8bdc-68f81bfd3954 req-5088538e-4e01-4ce7-a144-e78c119b0579 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bba229d-781a-409e-8079-6c9764d8124b", "name": "network-vif-plugged", "status": "completed", "tag": "6da7b6cb-d1db-46c0-b902-4f615a911fcf"}]} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:54:41.290591 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 04:54:41.290591 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: warnings.warn(msg) Aug 07 04:54:41.301057 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-1d85b543-5dd2-466f-8bdc-68f81bfd3954 req-5088538e-4e01-4ce7-a144-e78c119b0579 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:41.301665 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-1d85b543-5dd2-466f-8bdc-68f81bfd3954 req-5088538e-4e01-4ce7-a144-e78c119b0579 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:41.322755 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.compute.server_external_events [req-1d85b543-5dd2-466f-8bdc-68f81bfd3954 req-5088538e-4e01-4ce7-a144-e78c119b0579 service nova] Creating event network-vif-plugged:6da7b6cb-d1db-46c0-b902-4f615a911fcf for instance 3bba229d-781a-409e-8079-6c9764d8124b on hv-cinder-80374 Aug 07 04:54:41.328462 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [req-1d85b543-5dd2-466f-8bdc-68f81bfd3954 req-5088538e-4e01-4ce7-a144-e78c119b0579 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044095 Aug 07 04:54:41.329371 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 98/191] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 04:54:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:54:41.626873 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-cad65029-53eb-4df8-b759-c596e25552d3 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:41.628230 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-cad65029-53eb-4df8-b759-c596e25552d3 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:41.635097 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-cad65029-53eb-4df8-b759-c596e25552d3 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:41.635844 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-cad65029-53eb-4df8-b759-c596e25552d3 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:41.637488 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-cad65029-53eb-4df8-b759-c596e25552d3 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:41.638208 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-cad65029-53eb-4df8-b759-c596e25552d3 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:41.759835 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-cad65029-53eb-4df8-b759-c596e25552d3 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:41.767976 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-cad65029-53eb-4df8-b759-c596e25552d3 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b" status: 200 len: 1318 microversion: 2.1 time: 0.146454 Aug 07 04:54:41.768546 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 94/192] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:41 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:41.872528 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-5fbeaaf0-a4e6-4fb5-912f-77bff64125e5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:41.873117 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-5fbeaaf0-a4e6-4fb5-912f-77bff64125e5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:41.874807 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-a19f822b-5e4c-49ed-89b8-6e9dd4cb5f8d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:41.875417 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-a19f822b-5e4c-49ed-89b8-6e9dd4cb5f8d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:41.879137 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5fbeaaf0-a4e6-4fb5-912f-77bff64125e5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:41.879577 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5fbeaaf0-a4e6-4fb5-912f-77bff64125e5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:41.880329 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5fbeaaf0-a4e6-4fb5-912f-77bff64125e5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:41.880752 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5fbeaaf0-a4e6-4fb5-912f-77bff64125e5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:41.881063 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a19f822b-5e4c-49ed-89b8-6e9dd4cb5f8d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:41.881509 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a19f822b-5e4c-49ed-89b8-6e9dd4cb5f8d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:41.882273 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a19f822b-5e4c-49ed-89b8-6e9dd4cb5f8d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:41.882704 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a19f822b-5e4c-49ed-89b8-6e9dd4cb5f8d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:42.013879 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-a19f822b-5e4c-49ed-89b8-6e9dd4cb5f8d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:42.018306 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-5fbeaaf0-a4e6-4fb5-912f-77bff64125e5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:42.022328 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-a19f822b-5e4c-49ed-89b8-6e9dd4cb5f8d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:42.023818 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-a19f822b-5e4c-49ed-89b8-6e9dd4cb5f8d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:42.025344 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-a19f822b-5e4c-49ed-89b8-6e9dd4cb5f8d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1403 microversion: 2.20 time: 0.154800 Aug 07 04:54:42.025967 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-5fbeaaf0-a4e6-4fb5-912f-77bff64125e5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1322 microversion: 2.1 time: 0.158540 Aug 07 04:54:42.026559 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 99/194] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:41 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:42.026763 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 95/194] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:54:41 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1403 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 04:54:42.784525 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-dcb6139e-ed98-4dd6-9dd8-6df98a897be6 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:42.785135 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-dcb6139e-ed98-4dd6-9dd8-6df98a897be6 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:42.790916 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-dcb6139e-ed98-4dd6-9dd8-6df98a897be6 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:42.791359 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-dcb6139e-ed98-4dd6-9dd8-6df98a897be6 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:42.792119 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-dcb6139e-ed98-4dd6-9dd8-6df98a897be6 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:42.792747 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-dcb6139e-ed98-4dd6-9dd8-6df98a897be6 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:42.911840 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-dcb6139e-ed98-4dd6-9dd8-6df98a897be6 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:42.919257 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-dcb6139e-ed98-4dd6-9dd8-6df98a897be6 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b" status: 200 len: 1318 microversion: 2.1 time: 0.138482 Aug 07 04:54:42.919813 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 96/195] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:42 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b => generated 1318 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:43.042130 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-e1722d0b-5393-41db-8da0-a3e8e17c22a9 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:43.042666 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-e1722d0b-5393-41db-8da0-a3e8e17c22a9 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:43.043937 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-7b93a187-2b89-45c7-80cd-f07a1631dff4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:43.044593 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-7b93a187-2b89-45c7-80cd-f07a1631dff4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:43.049221 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e1722d0b-5393-41db-8da0-a3e8e17c22a9 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:43.049662 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e1722d0b-5393-41db-8da0-a3e8e17c22a9 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:43.050267 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7b93a187-2b89-45c7-80cd-f07a1631dff4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:43.050457 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e1722d0b-5393-41db-8da0-a3e8e17c22a9 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:43.050718 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7b93a187-2b89-45c7-80cd-f07a1631dff4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:43.050879 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e1722d0b-5393-41db-8da0-a3e8e17c22a9 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:43.051485 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7b93a187-2b89-45c7-80cd-f07a1631dff4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:43.051917 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7b93a187-2b89-45c7-80cd-f07a1631dff4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:43.172555 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-7b93a187-2b89-45c7-80cd-f07a1631dff4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:43.173190 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-e1722d0b-5393-41db-8da0-a3e8e17c22a9 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:43.180301 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-7b93a187-2b89-45c7-80cd-f07a1631dff4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:43.180441 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-e1722d0b-5393-41db-8da0-a3e8e17c22a9 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1322 microversion: 2.1 time: 0.142052 Aug 07 04:54:43.181023 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 100/196] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:43 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1322 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:43.181803 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-7b93a187-2b89-45c7-80cd-f07a1631dff4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:43.182866 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-7b93a187-2b89-45c7-80cd-f07a1631dff4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1403 microversion: 2.20 time: 0.143173 Aug 07 04:54:43.183411 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 97/197] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:54:43 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1403 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 04:54:43.935849 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-3a4ffff5-a57a-4cd8-a2be-d1e22c45df17 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:43.936506 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-3a4ffff5-a57a-4cd8-a2be-d1e22c45df17 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:43.942719 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3a4ffff5-a57a-4cd8-a2be-d1e22c45df17 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:43.943154 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3a4ffff5-a57a-4cd8-a2be-d1e22c45df17 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:43.943938 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3a4ffff5-a57a-4cd8-a2be-d1e22c45df17 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:43.944367 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3a4ffff5-a57a-4cd8-a2be-d1e22c45df17 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:44.066227 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-3a4ffff5-a57a-4cd8-a2be-d1e22c45df17 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:44.078288 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-3a4ffff5-a57a-4cd8-a2be-d1e22c45df17 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b" status: 200 len: 1318 microversion: 2.1 time: 0.146846 Aug 07 04:54:44.078861 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 101/198] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:43 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:44.197250 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-7e0189b0-1f8e-48ce-8543-25fc56fada3d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:44.197851 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-7e0189b0-1f8e-48ce-8543-25fc56fada3d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:44.200755 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-b3e604d1-2c5b-430d-97df-a6e612920ce1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:44.201479 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-b3e604d1-2c5b-430d-97df-a6e612920ce1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:44.204250 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7e0189b0-1f8e-48ce-8543-25fc56fada3d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:44.204687 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7e0189b0-1f8e-48ce-8543-25fc56fada3d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:44.205475 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7e0189b0-1f8e-48ce-8543-25fc56fada3d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:44.205906 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7e0189b0-1f8e-48ce-8543-25fc56fada3d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:44.207359 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b3e604d1-2c5b-430d-97df-a6e612920ce1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:44.207792 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b3e604d1-2c5b-430d-97df-a6e612920ce1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:44.208594 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b3e604d1-2c5b-430d-97df-a6e612920ce1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:44.209079 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b3e604d1-2c5b-430d-97df-a6e612920ce1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:44.329632 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-7e0189b0-1f8e-48ce-8543-25fc56fada3d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:44.330842 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-b3e604d1-2c5b-430d-97df-a6e612920ce1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:44.336766 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-7e0189b0-1f8e-48ce-8543-25fc56fada3d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1322 microversion: 2.1 time: 0.143143 Aug 07 04:54:44.337353 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 98/199] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:44 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1322 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:44.338637 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-b3e604d1-2c5b-430d-97df-a6e612920ce1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:44.341073 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-b3e604d1-2c5b-430d-97df-a6e612920ce1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:44.342156 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-b3e604d1-2c5b-430d-97df-a6e612920ce1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1403 microversion: 2.20 time: 0.145781 Aug 07 04:54:44.342698 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 102/200] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:54:44 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1403 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 04:54:45.095138 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-cd049ed5-b5e9-42e5-b3c5-d69705ce616b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:45.095744 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-cd049ed5-b5e9-42e5-b3c5-d69705ce616b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:45.101677 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-cd049ed5-b5e9-42e5-b3c5-d69705ce616b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:45.102122 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-cd049ed5-b5e9-42e5-b3c5-d69705ce616b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:45.102889 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-cd049ed5-b5e9-42e5-b3c5-d69705ce616b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:45.103322 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-cd049ed5-b5e9-42e5-b3c5-d69705ce616b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:45.220904 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-cd049ed5-b5e9-42e5-b3c5-d69705ce616b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:45.227982 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-cd049ed5-b5e9-42e5-b3c5-d69705ce616b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b" status: 200 len: 1318 microversion: 2.1 time: 0.136504 Aug 07 04:54:45.228527 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 99/201] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:45 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b => generated 1318 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:54:45.354258 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-95b73960-e0d0-4bb7-ae50-ebb43863c7a4 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:45.354763 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-95b73960-e0d0-4bb7-ae50-ebb43863c7a4 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:45.359539 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-f46dfb08-3bcd-4fa2-97ac-c53219c7e8ab tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:45.360261 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-f46dfb08-3bcd-4fa2-97ac-c53219c7e8ab tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:45.361253 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-95b73960-e0d0-4bb7-ae50-ebb43863c7a4 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:45.361703 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-95b73960-e0d0-4bb7-ae50-ebb43863c7a4 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:45.362473 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-95b73960-e0d0-4bb7-ae50-ebb43863c7a4 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:45.362904 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-95b73960-e0d0-4bb7-ae50-ebb43863c7a4 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:45.365882 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f46dfb08-3bcd-4fa2-97ac-c53219c7e8ab tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:45.366320 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f46dfb08-3bcd-4fa2-97ac-c53219c7e8ab tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:45.367076 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f46dfb08-3bcd-4fa2-97ac-c53219c7e8ab tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:45.367508 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f46dfb08-3bcd-4fa2-97ac-c53219c7e8ab tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:45.485675 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-95b73960-e0d0-4bb7-ae50-ebb43863c7a4 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:45.486967 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-f46dfb08-3bcd-4fa2-97ac-c53219c7e8ab tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:45.493014 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-95b73960-e0d0-4bb7-ae50-ebb43863c7a4 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1322 microversion: 2.1 time: 0.142435 Aug 07 04:54:45.502656 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 103/202] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:45 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1322 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:45.503348 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-f46dfb08-3bcd-4fa2-97ac-c53219c7e8ab tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:45.503348 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-f46dfb08-3bcd-4fa2-97ac-c53219c7e8ab tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:45.503348 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-f46dfb08-3bcd-4fa2-97ac-c53219c7e8ab tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1403 microversion: 2.20 time: 0.143003 Aug 07 04:54:45.503686 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 100/203] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:54:45 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1403 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 04:54:46.245034 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-4a49e734-fb16-4e64-ae2e-6ff61c39228c tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:46.245581 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-4a49e734-fb16-4e64-ae2e-6ff61c39228c tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:46.251697 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4a49e734-fb16-4e64-ae2e-6ff61c39228c tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:46.252133 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4a49e734-fb16-4e64-ae2e-6ff61c39228c tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:46.252914 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4a49e734-fb16-4e64-ae2e-6ff61c39228c tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:46.253337 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4a49e734-fb16-4e64-ae2e-6ff61c39228c tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:46.369233 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-4a49e734-fb16-4e64-ae2e-6ff61c39228c tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:46.376425 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-4a49e734-fb16-4e64-ae2e-6ff61c39228c tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b" status: 200 len: 1318 microversion: 2.1 time: 0.135319 Aug 07 04:54:46.377011 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 104/204] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:46 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b => generated 1318 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:46.510364 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-d99b448c-e69a-42f6-bff5-876cff0a73f8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:46.510893 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-d99b448c-e69a-42f6-bff5-876cff0a73f8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:46.515872 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-8c68f527-0ce5-43d1-98c0-a2df87d51a6e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:46.516480 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-8c68f527-0ce5-43d1-98c0-a2df87d51a6e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:46.517724 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d99b448c-e69a-42f6-bff5-876cff0a73f8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:46.518173 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d99b448c-e69a-42f6-bff5-876cff0a73f8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:46.518948 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d99b448c-e69a-42f6-bff5-876cff0a73f8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:46.519415 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d99b448c-e69a-42f6-bff5-876cff0a73f8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:46.522528 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8c68f527-0ce5-43d1-98c0-a2df87d51a6e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:46.523100 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8c68f527-0ce5-43d1-98c0-a2df87d51a6e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:46.523864 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8c68f527-0ce5-43d1-98c0-a2df87d51a6e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:46.524294 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8c68f527-0ce5-43d1-98c0-a2df87d51a6e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:46.648380 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-d99b448c-e69a-42f6-bff5-876cff0a73f8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:46.654404 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-8c68f527-0ce5-43d1-98c0-a2df87d51a6e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:46.656596 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-d99b448c-e69a-42f6-bff5-876cff0a73f8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1322 microversion: 2.1 time: 0.150074 Aug 07 04:54:46.657188 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 101/205] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:46 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:46.662322 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-8c68f527-0ce5-43d1-98c0-a2df87d51a6e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:46.663807 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-8c68f527-0ce5-43d1-98c0-a2df87d51a6e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:46.664916 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-8c68f527-0ce5-43d1-98c0-a2df87d51a6e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1403 microversion: 2.20 time: 0.153675 Aug 07 04:54:46.665438 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 105/206] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:54:46 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1403 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 04:54:47.392876 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-3343bd85-8f0e-485e-91b4-2f745b64f69c tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:47.393489 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-3343bd85-8f0e-485e-91b4-2f745b64f69c tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:47.399270 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3343bd85-8f0e-485e-91b4-2f745b64f69c tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:47.399715 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3343bd85-8f0e-485e-91b4-2f745b64f69c tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:47.400486 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3343bd85-8f0e-485e-91b4-2f745b64f69c tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:47.400956 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3343bd85-8f0e-485e-91b4-2f745b64f69c tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:47.534043 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-3343bd85-8f0e-485e-91b4-2f745b64f69c tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:47.542127 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-3343bd85-8f0e-485e-91b4-2f745b64f69c tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b" status: 200 len: 1318 microversion: 2.1 time: 0.152920 Aug 07 04:54:47.544816 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 102/207] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:47 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:47.674057 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-66ea2138-d42b-4e51-9c3a-855c4b11c8f6 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:47.674620 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-66ea2138-d42b-4e51-9c3a-855c4b11c8f6 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:47.681068 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-66ea2138-d42b-4e51-9c3a-855c4b11c8f6 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:47.681518 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-66ea2138-d42b-4e51-9c3a-855c4b11c8f6 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:47.681634 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-e7a9157e-7ed2-42f5-aad2-bd7f2d5ceccc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:47.682195 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-e7a9157e-7ed2-42f5-aad2-bd7f2d5ceccc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:47.682308 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-66ea2138-d42b-4e51-9c3a-855c4b11c8f6 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:47.682862 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-66ea2138-d42b-4e51-9c3a-855c4b11c8f6 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:47.688007 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e7a9157e-7ed2-42f5-aad2-bd7f2d5ceccc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:47.688451 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e7a9157e-7ed2-42f5-aad2-bd7f2d5ceccc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:47.689284 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e7a9157e-7ed2-42f5-aad2-bd7f2d5ceccc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:47.689720 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e7a9157e-7ed2-42f5-aad2-bd7f2d5ceccc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:47.803403 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-66ea2138-d42b-4e51-9c3a-855c4b11c8f6 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:47.810303 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-e7a9157e-7ed2-42f5-aad2-bd7f2d5ceccc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:47.811915 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-66ea2138-d42b-4e51-9c3a-855c4b11c8f6 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1517 microversion: 2.1 time: 0.141564 Aug 07 04:54:47.813209 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 106/208] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:47 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1517 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:47.818552 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-e7a9157e-7ed2-42f5-aad2-bd7f2d5ceccc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:47.824942 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-e7a9157e-7ed2-42f5-aad2-bd7f2d5ceccc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:47.824942 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-e7a9157e-7ed2-42f5-aad2-bd7f2d5ceccc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1595 microversion: 2.20 time: 0.143421 Aug 07 04:54:47.824942 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 103/209] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:54:47 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1595 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 04:54:47.838619 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-6df1d52f-8c2f-4490-96eb-e80694d716af tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:54:47.840687 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-6df1d52f-8c2f-4490-96eb-e80694d716af tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:47.841343 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-74ba38b3-e9e7-4252-9f18-99bee0cf232a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:47.841343 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-74ba38b3-e9e7-4252-9f18-99bee0cf232a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:47.847481 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-74ba38b3-e9e7-4252-9f18-99bee0cf232a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:47.847610 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6df1d52f-8c2f-4490-96eb-e80694d716af tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:47.847940 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-74ba38b3-e9e7-4252-9f18-99bee0cf232a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:47.848053 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6df1d52f-8c2f-4490-96eb-e80694d716af tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:47.848708 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-74ba38b3-e9e7-4252-9f18-99bee0cf232a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:47.848854 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6df1d52f-8c2f-4490-96eb-e80694d716af tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:47.849188 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-74ba38b3-e9e7-4252-9f18-99bee0cf232a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:47.849297 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6df1d52f-8c2f-4490-96eb-e80694d716af tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:47.871937 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.objects.instance [None req-6df1d52f-8c2f-4490-96eb-e80694d716af tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lazy-loading 'flavor' on Instance uuid 7660d04d-3aad-49e0-b8a5-12820fcb4d66 {{(pid=107486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 04:54:47.970406 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-74ba38b3-e9e7-4252-9f18-99bee0cf232a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.134441 Aug 07 04:54:47.971035 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 104/210] 10.222.0.35 () {60 vars in 1316 bytes} [Sat Aug 7 04:54:47 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/os-interface => generated 285 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 07 04:54:47.990815 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-6df1d52f-8c2f-4490-96eb-e80694d716af tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "POST /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66/action" status: 200 len: 32 microversion: 2.1 time: 0.161276 Aug 07 04:54:47.991447 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 107/211] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 04:54:47 2021] POST /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66/action => generated 32 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 04:54:48.000183 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-b7d9a8ac-b0f6-435b-97b2-1fee5c9c0aa2 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:48.000814 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-b7d9a8ac-b0f6-435b-97b2-1fee5c9c0aa2 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:48.006743 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b7d9a8ac-b0f6-435b-97b2-1fee5c9c0aa2 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:48.007179 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b7d9a8ac-b0f6-435b-97b2-1fee5c9c0aa2 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:48.007943 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b7d9a8ac-b0f6-435b-97b2-1fee5c9c0aa2 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:48.008372 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b7d9a8ac-b0f6-435b-97b2-1fee5c9c0aa2 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:48.142367 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-b7d9a8ac-b0f6-435b-97b2-1fee5c9c0aa2 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:48.158871 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-b7d9a8ac-b0f6-435b-97b2-1fee5c9c0aa2 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1523 microversion: 2.1 time: 0.162277 Aug 07 04:54:48.159701 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 105/212] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:47 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:48.560467 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-611de1e0-f3bc-4ba0-81a3-a4691f88179e tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:48.561204 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-611de1e0-f3bc-4ba0-81a3-a4691f88179e tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:48.568367 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-611de1e0-f3bc-4ba0-81a3-a4691f88179e tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:48.568838 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-611de1e0-f3bc-4ba0-81a3-a4691f88179e tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:48.569628 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-611de1e0-f3bc-4ba0-81a3-a4691f88179e tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:48.570050 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-611de1e0-f3bc-4ba0-81a3-a4691f88179e tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:48.981804 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-611de1e0-f3bc-4ba0-81a3-a4691f88179e tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:48.989034 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-611de1e0-f3bc-4ba0-81a3-a4691f88179e tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b" status: 200 len: 1318 microversion: 2.1 time: 0.433249 Aug 07 04:54:48.989595 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 108/213] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:48 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b => generated 1318 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:54:49.176689 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-32569ec3-c540-464f-a25b-17fa78abf1c5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:49.177336 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-32569ec3-c540-464f-a25b-17fa78abf1c5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:49.183116 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-32569ec3-c540-464f-a25b-17fa78abf1c5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:49.184105 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-32569ec3-c540-464f-a25b-17fa78abf1c5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:49.184926 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-32569ec3-c540-464f-a25b-17fa78abf1c5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:49.185346 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-32569ec3-c540-464f-a25b-17fa78abf1c5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:49.306636 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-32569ec3-c540-464f-a25b-17fa78abf1c5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:49.314601 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-32569ec3-c540-464f-a25b-17fa78abf1c5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1523 microversion: 2.1 time: 0.141418 Aug 07 04:54:49.315274 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 106/214] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:49 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1523 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:49.757964 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-41f40d9a-17e0-493e-b635-2edc590d092f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:54:49.758992 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-41f40d9a-17e0-493e-b635-2edc590d092f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:49.765568 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [req-0c23bc0d-34f7-4d30-b589-99ab2f5848ea req-2e44e9bf-728d-4373-b88f-7a1c10148391 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "431857b6-a453-44f0-829c-00ed610d5fc2", "tag": "6a0264c8-c45c-4fec-b570-31fbf0131107"}]} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:54:49.767331 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 04:54:49.767331 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: warnings.warn(msg) Aug 07 04:54:49.767618 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-41f40d9a-17e0-493e-b635-2edc590d092f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:49.767816 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-41f40d9a-17e0-493e-b635-2edc590d092f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:49.768757 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-41f40d9a-17e0-493e-b635-2edc590d092f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:49.771029 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-41f40d9a-17e0-493e-b635-2edc590d092f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:49.778832 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-0c23bc0d-34f7-4d30-b589-99ab2f5848ea req-2e44e9bf-728d-4373-b88f-7a1c10148391 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:49.779356 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-0c23bc0d-34f7-4d30-b589-99ab2f5848ea req-2e44e9bf-728d-4373-b88f-7a1c10148391 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:49.790511 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.compute.server_external_events [req-0c23bc0d-34f7-4d30-b589-99ab2f5848ea req-2e44e9bf-728d-4373-b88f-7a1c10148391 service nova] Creating event network-changed:6a0264c8-c45c-4fec-b570-31fbf0131107 for instance 431857b6-a453-44f0-829c-00ed610d5fc2 on hv-cinder-80374 Aug 07 04:54:49.796384 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [req-0c23bc0d-34f7-4d30-b589-99ab2f5848ea req-2e44e9bf-728d-4373-b88f-7a1c10148391 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034498 Aug 07 04:54:49.797297 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 107/215] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 04:54:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:54:50.006570 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-de68d66e-1b27-4614-b3e8-82f8858a1f4a tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:50.007311 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-de68d66e-1b27-4614-b3e8-82f8858a1f4a tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:50.014351 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-de68d66e-1b27-4614-b3e8-82f8858a1f4a tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:50.014791 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-de68d66e-1b27-4614-b3e8-82f8858a1f4a tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:50.015567 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-de68d66e-1b27-4614-b3e8-82f8858a1f4a tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:50.015998 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-de68d66e-1b27-4614-b3e8-82f8858a1f4a tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:50.147613 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-de68d66e-1b27-4614-b3e8-82f8858a1f4a tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:50.155473 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-de68d66e-1b27-4614-b3e8-82f8858a1f4a tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b" status: 200 len: 1318 microversion: 2.1 time: 0.153063 Aug 07 04:54:50.156035 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 108/216] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:50 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:54:50.331044 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-c541f9a8-2535-43bc-a2ee-c6b6f5231f55 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:50.331634 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-c541f9a8-2535-43bc-a2ee-c6b6f5231f55 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:50.337910 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c541f9a8-2535-43bc-a2ee-c6b6f5231f55 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:50.338365 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c541f9a8-2535-43bc-a2ee-c6b6f5231f55 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:50.339290 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c541f9a8-2535-43bc-a2ee-c6b6f5231f55 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:50.340837 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c541f9a8-2535-43bc-a2ee-c6b6f5231f55 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:50.466229 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-c541f9a8-2535-43bc-a2ee-c6b6f5231f55 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:50.473553 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-c541f9a8-2535-43bc-a2ee-c6b6f5231f55 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1523 microversion: 2.1 time: 0.146148 Aug 07 04:54:50.474111 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 109/217] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:50 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1523 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:54:51.171762 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-7a7e32eb-a3ce-4a71-8f13-11b9221ac038 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:51.172365 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-7a7e32eb-a3ce-4a71-8f13-11b9221ac038 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:51.178158 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7a7e32eb-a3ce-4a71-8f13-11b9221ac038 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:51.178591 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7a7e32eb-a3ce-4a71-8f13-11b9221ac038 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:51.179336 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7a7e32eb-a3ce-4a71-8f13-11b9221ac038 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:51.179757 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7a7e32eb-a3ce-4a71-8f13-11b9221ac038 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:51.296916 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-7a7e32eb-a3ce-4a71-8f13-11b9221ac038 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:51.303976 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-7a7e32eb-a3ce-4a71-8f13-11b9221ac038 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b" status: 200 len: 1318 microversion: 2.1 time: 0.136472 Aug 07 04:54:51.304535 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 110/218] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:51 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b => generated 1318 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:54:51.490828 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-11707384-3ed5-488a-acf9-841742da70da tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:51.491480 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-11707384-3ed5-488a-acf9-841742da70da tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:51.497910 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-11707384-3ed5-488a-acf9-841742da70da tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:51.498357 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-11707384-3ed5-488a-acf9-841742da70da tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:51.499121 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-11707384-3ed5-488a-acf9-841742da70da tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:51.499651 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-11707384-3ed5-488a-acf9-841742da70da tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:51.617971 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-11707384-3ed5-488a-acf9-841742da70da tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:51.625368 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-11707384-3ed5-488a-acf9-841742da70da tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1523 microversion: 2.1 time: 0.139137 Aug 07 04:54:51.625919 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 111/219] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:51 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1523 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:54:52.320266 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-65ae5e0e-c192-4617-b3d7-755d3bb9ce0d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:52.320900 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-65ae5e0e-c192-4617-b3d7-755d3bb9ce0d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:52.327168 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-65ae5e0e-c192-4617-b3d7-755d3bb9ce0d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:52.327623 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-65ae5e0e-c192-4617-b3d7-755d3bb9ce0d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:52.328395 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-65ae5e0e-c192-4617-b3d7-755d3bb9ce0d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:52.328845 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-65ae5e0e-c192-4617-b3d7-755d3bb9ce0d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:52.454424 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-65ae5e0e-c192-4617-b3d7-755d3bb9ce0d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:52.461688 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-65ae5e0e-c192-4617-b3d7-755d3bb9ce0d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b" status: 200 len: 1318 microversion: 2.1 time: 0.145060 Aug 07 04:54:52.462247 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 112/220] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:52 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:54:52.642286 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-ac1ec9f2-158e-460e-ade1-650e5ac0c61b tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:52.642884 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-ac1ec9f2-158e-460e-ade1-650e5ac0c61b tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:52.648687 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ac1ec9f2-158e-460e-ade1-650e5ac0c61b tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:52.649164 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ac1ec9f2-158e-460e-ade1-650e5ac0c61b tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:52.649929 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ac1ec9f2-158e-460e-ade1-650e5ac0c61b tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:52.650364 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ac1ec9f2-158e-460e-ade1-650e5ac0c61b tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:52.769309 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-ac1ec9f2-158e-460e-ade1-650e5ac0c61b tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:52.776380 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-ac1ec9f2-158e-460e-ade1-650e5ac0c61b tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1523 microversion: 2.1 time: 0.137791 Aug 07 04:54:52.777010 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 113/221] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:52 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1523 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:54:53.478590 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-283aa4b6-7bce-4d31-9b41-acb877c60d11 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:53.479201 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-283aa4b6-7bce-4d31-9b41-acb877c60d11 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:53.485209 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-283aa4b6-7bce-4d31-9b41-acb877c60d11 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:53.485655 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-283aa4b6-7bce-4d31-9b41-acb877c60d11 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:53.486417 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-283aa4b6-7bce-4d31-9b41-acb877c60d11 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:53.486845 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-283aa4b6-7bce-4d31-9b41-acb877c60d11 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:53.605826 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-283aa4b6-7bce-4d31-9b41-acb877c60d11 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:53.613394 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-283aa4b6-7bce-4d31-9b41-acb877c60d11 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b" status: 200 len: 1318 microversion: 2.1 time: 0.138353 Aug 07 04:54:53.614301 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 114/222] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:53 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b => generated 1318 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:54:53.721529 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-41f40d9a-17e0-493e-b635-2edc590d092f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 14 microversion: 2.20 time: 3.967299 Aug 07 04:54:53.722574 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 109/223] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:54:49 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 14 bytes in 3969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:54:53.794658 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-ad4a4031-380c-4787-90b6-5b7f28c1ec03 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:53.795260 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-ad4a4031-380c-4787-90b6-5b7f28c1ec03 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:53.801164 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ad4a4031-380c-4787-90b6-5b7f28c1ec03 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:53.801603 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ad4a4031-380c-4787-90b6-5b7f28c1ec03 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:53.802406 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ad4a4031-380c-4787-90b6-5b7f28c1ec03 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:53.802832 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ad4a4031-380c-4787-90b6-5b7f28c1ec03 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:54.044396 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-ad4a4031-380c-4787-90b6-5b7f28c1ec03 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:54.052039 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-ad4a4031-380c-4787-90b6-5b7f28c1ec03 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1523 microversion: 2.1 time: 0.262317 Aug 07 04:54:54.052604 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 115/224] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:53 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1523 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:54.631355 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-f25a1937-490a-49ae-b4b1-9759ef753e37 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:54.632049 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-f25a1937-490a-49ae-b4b1-9759ef753e37 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:54.639698 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f25a1937-490a-49ae-b4b1-9759ef753e37 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:54.640143 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f25a1937-490a-49ae-b4b1-9759ef753e37 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:54.640942 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f25a1937-490a-49ae-b4b1-9759ef753e37 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:54.641377 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f25a1937-490a-49ae-b4b1-9759ef753e37 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:54.731529 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-d24eb328-a30f-4aa2-afad-42a8acec9f7f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:54:54.732478 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-d24eb328-a30f-4aa2-afad-42a8acec9f7f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:54.738880 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d24eb328-a30f-4aa2-afad-42a8acec9f7f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:54.739422 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d24eb328-a30f-4aa2-afad-42a8acec9f7f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:54.740270 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d24eb328-a30f-4aa2-afad-42a8acec9f7f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:54.740828 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d24eb328-a30f-4aa2-afad-42a8acec9f7f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:54.775259 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-f25a1937-490a-49ae-b4b1-9759ef753e37 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:54.783991 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-f25a1937-490a-49ae-b4b1-9759ef753e37 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b" status: 200 len: 1318 microversion: 2.1 time: 0.156739 Aug 07 04:54:54.784553 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 110/225] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:54 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:55.069103 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-db108131-d0a0-40f3-b876-9c5744e41cab tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:55.069626 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-db108131-d0a0-40f3-b876-9c5744e41cab tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:55.076136 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-db108131-d0a0-40f3-b876-9c5744e41cab tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:55.076577 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-db108131-d0a0-40f3-b876-9c5744e41cab tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:55.077377 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-db108131-d0a0-40f3-b876-9c5744e41cab tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:55.077809 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-db108131-d0a0-40f3-b876-9c5744e41cab tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:55.203331 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-db108131-d0a0-40f3-b876-9c5744e41cab tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:55.210725 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-db108131-d0a0-40f3-b876-9c5744e41cab tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1523 microversion: 2.1 time: 0.145537 Aug 07 04:54:55.211277 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 111/226] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:55 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1523 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:54:55.800479 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-c259eb58-25df-4fa3-b016-265fe1a0cf0e tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:55.801119 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-c259eb58-25df-4fa3-b016-265fe1a0cf0e tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:55.807329 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c259eb58-25df-4fa3-b016-265fe1a0cf0e tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:55.807768 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c259eb58-25df-4fa3-b016-265fe1a0cf0e tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:55.808534 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c259eb58-25df-4fa3-b016-265fe1a0cf0e tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:55.808996 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c259eb58-25df-4fa3-b016-265fe1a0cf0e tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:55.927447 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-c259eb58-25df-4fa3-b016-265fe1a0cf0e tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:55.934766 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-c259eb58-25df-4fa3-b016-265fe1a0cf0e tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b" status: 200 len: 1506 microversion: 2.1 time: 0.137915 Aug 07 04:54:55.935325 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 112/227] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:55 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b => generated 1506 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:56.228130 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-ab413760-374b-4f56-a620-bc04e6830d43 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:56.228704 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-ab413760-374b-4f56-a620-bc04e6830d43 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:56.235419 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ab413760-374b-4f56-a620-bc04e6830d43 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:56.235876 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ab413760-374b-4f56-a620-bc04e6830d43 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:56.236655 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ab413760-374b-4f56-a620-bc04e6830d43 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:56.237130 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ab413760-374b-4f56-a620-bc04e6830d43 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:56.354436 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-ab413760-374b-4f56-a620-bc04e6830d43 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:56.362309 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-ab413760-374b-4f56-a620-bc04e6830d43 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1523 microversion: 2.1 time: 0.138178 Aug 07 04:54:56.362866 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 113/228] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:56 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1523 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:54:57.378959 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-606be1bb-d607-40de-8a9b-4476ccefef6f tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:57.379583 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-606be1bb-d607-40de-8a9b-4476ccefef6f tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:57.386725 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-606be1bb-d607-40de-8a9b-4476ccefef6f tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:57.387178 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-606be1bb-d607-40de-8a9b-4476ccefef6f tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:57.387949 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-606be1bb-d607-40de-8a9b-4476ccefef6f tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:57.388377 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-606be1bb-d607-40de-8a9b-4476ccefef6f tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:57.509114 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-606be1bb-d607-40de-8a9b-4476ccefef6f tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:57.516242 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-606be1bb-d607-40de-8a9b-4476ccefef6f tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1523 microversion: 2.1 time: 0.140916 Aug 07 04:54:57.516803 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 114/229] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:57 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1523 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:54:57.786322 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-d24eb328-a30f-4aa2-afad-42a8acec9f7f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 14 microversion: 2.20 time: 3.058200 Aug 07 04:54:57.786817 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 116/230] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:54:54 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 14 bytes in 3060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:54:58.532262 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-59e2bedf-228a-41b6-ac01-bf8efcc6ffdd tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:58.532889 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-59e2bedf-228a-41b6-ac01-bf8efcc6ffdd tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:58.539360 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-59e2bedf-228a-41b6-ac01-bf8efcc6ffdd tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:58.539802 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-59e2bedf-228a-41b6-ac01-bf8efcc6ffdd tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:58.540586 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-59e2bedf-228a-41b6-ac01-bf8efcc6ffdd tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:58.541016 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-59e2bedf-228a-41b6-ac01-bf8efcc6ffdd tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:58.660773 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-59e2bedf-228a-41b6-ac01-bf8efcc6ffdd tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:58.668294 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-59e2bedf-228a-41b6-ac01-bf8efcc6ffdd tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1523 microversion: 2.1 time: 0.139631 Aug 07 04:54:58.668881 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 115/231] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:58 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1523 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:54:58.797309 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-5b760073-efc6-4e98-9d08-1a7ba6047375 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:54:58.798215 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-5b760073-efc6-4e98-9d08-1a7ba6047375 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:58.805983 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5b760073-efc6-4e98-9d08-1a7ba6047375 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:58.806426 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5b760073-efc6-4e98-9d08-1a7ba6047375 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:58.807181 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5b760073-efc6-4e98-9d08-1a7ba6047375 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:58.807608 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5b760073-efc6-4e98-9d08-1a7ba6047375 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:59.421258 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-5b760073-efc6-4e98-9d08-1a7ba6047375 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 8392 microversion: 2.20 time: 0.627778 Aug 07 04:54:59.424502 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 117/232] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:54:58 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 8392 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:54:59.684419 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-bacfbebd-6313-4997-a3d9-bd4bd2db86cb tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:54:59.685044 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-bacfbebd-6313-4997-a3d9-bd4bd2db86cb tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:54:59.690891 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-bacfbebd-6313-4997-a3d9-bd4bd2db86cb tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:59.691327 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-bacfbebd-6313-4997-a3d9-bd4bd2db86cb tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:59.692079 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-bacfbebd-6313-4997-a3d9-bd4bd2db86cb tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:54:59.692507 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-bacfbebd-6313-4997-a3d9-bd4bd2db86cb tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:54:59.814055 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-bacfbebd-6313-4997-a3d9-bd4bd2db86cb tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:54:59.822059 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-bacfbebd-6313-4997-a3d9-bd4bd2db86cb tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1523 microversion: 2.1 time: 0.141332 Aug 07 04:54:59.822617 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 116/233] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:54:59 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1523 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:55:00.440822 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-0c184f07-0de3-48ec-9ccd-65f472640d0a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:55:00.440822 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-0c184f07-0de3-48ec-9ccd-65f472640d0a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:00.440822 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0c184f07-0de3-48ec-9ccd-65f472640d0a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:00.440822 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0c184f07-0de3-48ec-9ccd-65f472640d0a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:00.441562 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0c184f07-0de3-48ec-9ccd-65f472640d0a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:00.441992 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0c184f07-0de3-48ec-9ccd-65f472640d0a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:00.564808 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-0c184f07-0de3-48ec-9ccd-65f472640d0a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 12758 microversion: 2.20 time: 0.136643 Aug 07 04:55:00.565492 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 118/234] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:55:00 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 12758 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:55:00.838875 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-51e0ab5c-4ec5-4de7-8aae-7a1bb5737276 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:00.839654 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-51e0ab5c-4ec5-4de7-8aae-7a1bb5737276 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:00.845678 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-51e0ab5c-4ec5-4de7-8aae-7a1bb5737276 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:00.846127 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-51e0ab5c-4ec5-4de7-8aae-7a1bb5737276 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:00.846889 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-51e0ab5c-4ec5-4de7-8aae-7a1bb5737276 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:00.847320 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-51e0ab5c-4ec5-4de7-8aae-7a1bb5737276 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:00.976710 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-51e0ab5c-4ec5-4de7-8aae-7a1bb5737276 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:00.984886 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-51e0ab5c-4ec5-4de7-8aae-7a1bb5737276 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1523 microversion: 2.1 time: 0.149609 Aug 07 04:55:00.985444 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 117/235] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:00 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:55:01.576337 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-2b5cc9f4-9289-434c-89ac-f5804155058e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:55:01.577344 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-2b5cc9f4-9289-434c-89ac-f5804155058e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:01.583696 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2b5cc9f4-9289-434c-89ac-f5804155058e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:01.584134 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2b5cc9f4-9289-434c-89ac-f5804155058e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:01.584913 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2b5cc9f4-9289-434c-89ac-f5804155058e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:01.585340 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2b5cc9f4-9289-434c-89ac-f5804155058e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:02.001530 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-78bbd128-76b3-49cf-a8ef-b3b841e1ac9a tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:02.002133 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-78bbd128-76b3-49cf-a8ef-b3b841e1ac9a tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:02.007928 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-78bbd128-76b3-49cf-a8ef-b3b841e1ac9a tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:02.008366 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-78bbd128-76b3-49cf-a8ef-b3b841e1ac9a tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:02.009140 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-78bbd128-76b3-49cf-a8ef-b3b841e1ac9a tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:02.009572 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-78bbd128-76b3-49cf-a8ef-b3b841e1ac9a tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:02.129506 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-78bbd128-76b3-49cf-a8ef-b3b841e1ac9a tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:02.137034 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-78bbd128-76b3-49cf-a8ef-b3b841e1ac9a tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1523 microversion: 2.1 time: 0.139029 Aug 07 04:55:02.137601 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 118/236] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:01 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1523 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:55:03.154125 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-c6dc32c2-ecef-4c33-848b-59ad7c7eeb5e tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:03.154731 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-c6dc32c2-ecef-4c33-848b-59ad7c7eeb5e tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:03.160877 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c6dc32c2-ecef-4c33-848b-59ad7c7eeb5e tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:03.161319 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c6dc32c2-ecef-4c33-848b-59ad7c7eeb5e tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:03.162072 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c6dc32c2-ecef-4c33-848b-59ad7c7eeb5e tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:03.162498 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c6dc32c2-ecef-4c33-848b-59ad7c7eeb5e tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:03.281106 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-c6dc32c2-ecef-4c33-848b-59ad7c7eeb5e tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:03.288326 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-c6dc32c2-ecef-4c33-848b-59ad7c7eeb5e tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1523 microversion: 2.1 time: 0.138544 Aug 07 04:55:03.288900 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 119/237] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:03 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1523 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:55:04.305149 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-92e2bb01-b611-4dac-bb99-13c3a3c828b7 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:04.305763 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-92e2bb01-b611-4dac-bb99-13c3a3c828b7 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:04.312188 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-92e2bb01-b611-4dac-bb99-13c3a3c828b7 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:04.312636 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-92e2bb01-b611-4dac-bb99-13c3a3c828b7 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:04.313434 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-92e2bb01-b611-4dac-bb99-13c3a3c828b7 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:04.313874 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-92e2bb01-b611-4dac-bb99-13c3a3c828b7 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:04.435404 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-92e2bb01-b611-4dac-bb99-13c3a3c828b7 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:04.442596 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-92e2bb01-b611-4dac-bb99-13c3a3c828b7 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1523 microversion: 2.1 time: 0.141242 Aug 07 04:55:04.443160 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 120/238] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:04 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1523 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:55:05.168668 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-2b5cc9f4-9289-434c-89ac-f5804155058e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 21513 microversion: 2.20 time: 3.596714 Aug 07 04:55:05.169354 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 119/239] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:55:01 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 21513 bytes in 3598 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:55:05.460257 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-0c44f6db-3885-4393-968d-eb670f78fbcf tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:05.460880 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-0c44f6db-3885-4393-968d-eb670f78fbcf tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:05.467147 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0c44f6db-3885-4393-968d-eb670f78fbcf tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:05.467607 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0c44f6db-3885-4393-968d-eb670f78fbcf tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:05.468364 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0c44f6db-3885-4393-968d-eb670f78fbcf tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:05.469257 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0c44f6db-3885-4393-968d-eb670f78fbcf tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:05.586860 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-0c44f6db-3885-4393-968d-eb670f78fbcf tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:05.594346 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-0c44f6db-3885-4393-968d-eb670f78fbcf tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1523 microversion: 2.1 time: 0.137780 Aug 07 04:55:05.594905 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 121/240] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:05 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1523 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:55:06.180329 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-43e38f14-c718-48e0-aa02-095cce88be9a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:55:06.181341 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-43e38f14-c718-48e0-aa02-095cce88be9a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:06.188364 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-43e38f14-c718-48e0-aa02-095cce88be9a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:06.188812 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-43e38f14-c718-48e0-aa02-095cce88be9a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:06.189580 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-43e38f14-c718-48e0-aa02-095cce88be9a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:06.190004 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-43e38f14-c718-48e0-aa02-095cce88be9a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:06.302950 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-43e38f14-c718-48e0-aa02-095cce88be9a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 22840 microversion: 2.20 time: 0.126490 Aug 07 04:55:06.303486 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 120/241] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:55:06 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 22840 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:55:06.611546 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-094746e6-f32a-4e7a-8763-06ed262f02dd tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:06.612148 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-094746e6-f32a-4e7a-8763-06ed262f02dd tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:06.618467 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-094746e6-f32a-4e7a-8763-06ed262f02dd tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:06.618925 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-094746e6-f32a-4e7a-8763-06ed262f02dd tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:06.619709 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-094746e6-f32a-4e7a-8763-06ed262f02dd tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:06.620659 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-094746e6-f32a-4e7a-8763-06ed262f02dd tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:06.742690 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-094746e6-f32a-4e7a-8763-06ed262f02dd tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:06.751704 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-094746e6-f32a-4e7a-8763-06ed262f02dd tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1523 microversion: 2.1 time: 0.144484 Aug 07 04:55:06.752413 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 122/242] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:06 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1523 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:55:07.315079 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-f3461330-6b1a-4757-8daa-25bd150388d8 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:55:07.316080 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-f3461330-6b1a-4757-8daa-25bd150388d8 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:07.322510 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f3461330-6b1a-4757-8daa-25bd150388d8 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:07.323156 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f3461330-6b1a-4757-8daa-25bd150388d8 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:07.324297 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f3461330-6b1a-4757-8daa-25bd150388d8 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:07.324729 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f3461330-6b1a-4757-8daa-25bd150388d8 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:07.446405 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-f3461330-6b1a-4757-8daa-25bd150388d8 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 23796 microversion: 2.20 time: 0.135136 Aug 07 04:55:07.447245 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 121/243] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:55:07 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 23796 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:55:07.769184 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-629de1e2-556e-40b5-a11c-cdb17472fac3 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:07.770593 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-629de1e2-556e-40b5-a11c-cdb17472fac3 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:07.776339 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-629de1e2-556e-40b5-a11c-cdb17472fac3 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:07.776949 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-629de1e2-556e-40b5-a11c-cdb17472fac3 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:07.777881 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-629de1e2-556e-40b5-a11c-cdb17472fac3 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:07.778311 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-629de1e2-556e-40b5-a11c-cdb17472fac3 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:07.805820 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-edfb3b10-8016-4db5-a159-ea28cc95b689 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "48e560e1-894f-4988-9022-d9410f707c18"}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:55:07.806957 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-edfb3b10-8016-4db5-a159-ea28cc95b689 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:07.814503 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-edfb3b10-8016-4db5-a159-ea28cc95b689 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:07.814952 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-edfb3b10-8016-4db5-a159-ea28cc95b689 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:07.815850 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-edfb3b10-8016-4db5-a159-ea28cc95b689 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:07.816296 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-edfb3b10-8016-4db5-a159-ea28cc95b689 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:07.920805 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-629de1e2-556e-40b5-a11c-cdb17472fac3 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:07.928813 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-629de1e2-556e-40b5-a11c-cdb17472fac3 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1523 microversion: 2.1 time: 0.163624 Aug 07 04:55:07.929452 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 123/244] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:07 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:55:08.112277 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-edfb3b10-8016-4db5-a159-ea28cc95b689 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "POST /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.310449 Aug 07 04:55:08.112921 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 122/245] 10.222.0.35 () {60 vars in 1323 bytes} [Sat Aug 7 04:55:07 2021] POST /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b/os-volume_attachments => generated 194 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:55:08.458783 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-8326a06b-70b2-47e2-91dc-ffc84e5a78b5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:55:08.459690 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-8326a06b-70b2-47e2-91dc-ffc84e5a78b5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:08.466053 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8326a06b-70b2-47e2-91dc-ffc84e5a78b5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:08.466493 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8326a06b-70b2-47e2-91dc-ffc84e5a78b5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:08.467322 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8326a06b-70b2-47e2-91dc-ffc84e5a78b5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:08.467750 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8326a06b-70b2-47e2-91dc-ffc84e5a78b5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:08.607911 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-8326a06b-70b2-47e2-91dc-ffc84e5a78b5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 24517 microversion: 2.20 time: 0.152771 Aug 07 04:55:08.609404 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 124/246] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:55:08 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 24517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 07 04:55:08.949825 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-66b64d19-7848-4901-bad1-203a169ac9c1 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:08.950514 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-66b64d19-7848-4901-bad1-203a169ac9c1 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:08.956409 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-66b64d19-7848-4901-bad1-203a169ac9c1 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:08.956878 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-66b64d19-7848-4901-bad1-203a169ac9c1 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:08.957638 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-66b64d19-7848-4901-bad1-203a169ac9c1 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:08.958067 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-66b64d19-7848-4901-bad1-203a169ac9c1 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:09.084487 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-66b64d19-7848-4901-bad1-203a169ac9c1 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:09.093433 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-66b64d19-7848-4901-bad1-203a169ac9c1 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1523 microversion: 2.1 time: 0.148197 Aug 07 04:55:09.093995 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 123/247] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:08 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:55:09.620687 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-e40c600d-e2c2-4aae-8fd0-0b540e6ab0dd tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:55:09.621960 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-e40c600d-e2c2-4aae-8fd0-0b540e6ab0dd tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:09.631381 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e40c600d-e2c2-4aae-8fd0-0b540e6ab0dd tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:09.631897 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e40c600d-e2c2-4aae-8fd0-0b540e6ab0dd tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:09.632734 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e40c600d-e2c2-4aae-8fd0-0b540e6ab0dd tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:09.633359 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e40c600d-e2c2-4aae-8fd0-0b540e6ab0dd tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:09.745719 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-e40c600d-e2c2-4aae-8fd0-0b540e6ab0dd tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 24937 microversion: 2.20 time: 0.129608 Aug 07 04:55:09.746352 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 125/248] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:55:09 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 24937 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:55:10.110832 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-9fe83f43-5930-4716-b04e-a4d8ba26c546 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:10.111882 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-9fe83f43-5930-4716-b04e-a4d8ba26c546 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:10.118019 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9fe83f43-5930-4716-b04e-a4d8ba26c546 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:10.118654 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9fe83f43-5930-4716-b04e-a4d8ba26c546 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:10.119430 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9fe83f43-5930-4716-b04e-a4d8ba26c546 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:10.120663 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9fe83f43-5930-4716-b04e-a4d8ba26c546 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:10.262777 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-9fe83f43-5930-4716-b04e-a4d8ba26c546 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:10.277749 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-9fe83f43-5930-4716-b04e-a4d8ba26c546 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1523 microversion: 2.1 time: 0.169756 Aug 07 04:55:10.278968 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 124/249] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:10 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:55:10.759734 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-ecd811d9-9e01-4664-aa7d-0bf26cdb37a4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:55:10.772741 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-ecd811d9-9e01-4664-aa7d-0bf26cdb37a4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:10.781910 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ecd811d9-9e01-4664-aa7d-0bf26cdb37a4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:10.782693 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ecd811d9-9e01-4664-aa7d-0bf26cdb37a4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:10.784165 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ecd811d9-9e01-4664-aa7d-0bf26cdb37a4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:10.784724 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ecd811d9-9e01-4664-aa7d-0bf26cdb37a4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:10.918774 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-ecd811d9-9e01-4664-aa7d-0bf26cdb37a4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 25872 microversion: 2.20 time: 0.164601 Aug 07 04:55:10.921084 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 126/250] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:55:10 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 25872 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:55:11.296001 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-e6230b14-6e36-484e-92e8-0bb6be8d705d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:11.296642 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-e6230b14-6e36-484e-92e8-0bb6be8d705d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:11.303806 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e6230b14-6e36-484e-92e8-0bb6be8d705d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:11.304258 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e6230b14-6e36-484e-92e8-0bb6be8d705d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:11.305062 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e6230b14-6e36-484e-92e8-0bb6be8d705d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:11.305515 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e6230b14-6e36-484e-92e8-0bb6be8d705d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:11.469703 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-e6230b14-6e36-484e-92e8-0bb6be8d705d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:11.486245 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-e6230b14-6e36-484e-92e8-0bb6be8d705d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1523 microversion: 2.1 time: 0.194596 Aug 07 04:55:11.496759 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 125/251] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:11 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1523 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:55:11.934532 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-3ebea65c-2655-421f-9f8b-755c0cbbf6d3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:55:11.936232 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-3ebea65c-2655-421f-9f8b-755c0cbbf6d3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:11.942800 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3ebea65c-2655-421f-9f8b-755c0cbbf6d3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:11.943432 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3ebea65c-2655-421f-9f8b-755c0cbbf6d3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:11.944440 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3ebea65c-2655-421f-9f8b-755c0cbbf6d3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:11.944989 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3ebea65c-2655-421f-9f8b-755c0cbbf6d3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:12.075336 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-3ebea65c-2655-421f-9f8b-755c0cbbf6d3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 26648 microversion: 2.20 time: 0.146474 Aug 07 04:55:12.076053 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 127/252] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:55:11 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 26648 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:55:12.507440 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-288f15fd-78b2-4b99-9be9-c1b7efbf2849 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:12.508084 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-288f15fd-78b2-4b99-9be9-c1b7efbf2849 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:12.514305 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-288f15fd-78b2-4b99-9be9-c1b7efbf2849 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:12.514758 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-288f15fd-78b2-4b99-9be9-c1b7efbf2849 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:12.515565 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-288f15fd-78b2-4b99-9be9-c1b7efbf2849 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:12.515999 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-288f15fd-78b2-4b99-9be9-c1b7efbf2849 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:12.650127 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-288f15fd-78b2-4b99-9be9-c1b7efbf2849 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:12.658981 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-288f15fd-78b2-4b99-9be9-c1b7efbf2849 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1523 microversion: 2.1 time: 0.159658 Aug 07 04:55:12.659565 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 126/253] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:12 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:55:13.088049 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-d42ef506-8553-4841-96c8-bd3923081b7e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:55:13.089127 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-d42ef506-8553-4841-96c8-bd3923081b7e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:13.096133 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d42ef506-8553-4841-96c8-bd3923081b7e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:13.096584 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d42ef506-8553-4841-96c8-bd3923081b7e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:13.097527 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d42ef506-8553-4841-96c8-bd3923081b7e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:13.097962 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d42ef506-8553-4841-96c8-bd3923081b7e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:13.234173 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-d42ef506-8553-4841-96c8-bd3923081b7e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 27116 microversion: 2.20 time: 0.150025 Aug 07 04:55:13.236827 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 128/254] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:55:13 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 27116 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:55:13.678417 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-fa04da1e-f57f-4769-b0ec-6b4ff252bdf8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:13.680531 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-fa04da1e-f57f-4769-b0ec-6b4ff252bdf8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:13.689440 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-fa04da1e-f57f-4769-b0ec-6b4ff252bdf8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:13.690103 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-fa04da1e-f57f-4769-b0ec-6b4ff252bdf8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:13.690952 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-fa04da1e-f57f-4769-b0ec-6b4ff252bdf8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:13.691442 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-fa04da1e-f57f-4769-b0ec-6b4ff252bdf8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:13.811248 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-fa04da1e-f57f-4769-b0ec-6b4ff252bdf8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:13.819031 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-fa04da1e-f57f-4769-b0ec-6b4ff252bdf8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1523 microversion: 2.1 time: 0.146420 Aug 07 04:55:13.819602 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 127/255] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:13 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1523 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:55:14.246736 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-d81ca48a-84af-486a-b6ce-dd9687a98e77 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:55:14.247736 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-d81ca48a-84af-486a-b6ce-dd9687a98e77 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:14.254210 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d81ca48a-84af-486a-b6ce-dd9687a98e77 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:14.254652 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d81ca48a-84af-486a-b6ce-dd9687a98e77 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:14.255416 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d81ca48a-84af-486a-b6ce-dd9687a98e77 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:14.255844 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d81ca48a-84af-486a-b6ce-dd9687a98e77 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:14.411572 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-d81ca48a-84af-486a-b6ce-dd9687a98e77 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 27567 microversion: 2.20 time: 0.169169 Aug 07 04:55:14.412361 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 129/256] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:55:14 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 27567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 07 04:55:14.835557 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-555353d9-cd9e-48ab-b390-cffe425d00d5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:14.836168 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-555353d9-cd9e-48ab-b390-cffe425d00d5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:14.843009 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-555353d9-cd9e-48ab-b390-cffe425d00d5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:14.843462 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-555353d9-cd9e-48ab-b390-cffe425d00d5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:14.844227 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-555353d9-cd9e-48ab-b390-cffe425d00d5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:14.844664 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-555353d9-cd9e-48ab-b390-cffe425d00d5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:14.964178 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-555353d9-cd9e-48ab-b390-cffe425d00d5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:14.972184 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-555353d9-cd9e-48ab-b390-cffe425d00d5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1523 microversion: 2.1 time: 0.140602 Aug 07 04:55:14.972859 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 128/257] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:14 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1523 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:55:15.423983 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-f3cce79c-be81-435b-8629-86f077d21fac tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:55:15.425017 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-f3cce79c-be81-435b-8629-86f077d21fac tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:15.431509 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f3cce79c-be81-435b-8629-86f077d21fac tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:15.431959 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f3cce79c-be81-435b-8629-86f077d21fac tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:15.432735 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f3cce79c-be81-435b-8629-86f077d21fac tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:15.433209 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f3cce79c-be81-435b-8629-86f077d21fac tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:15.550644 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-f3cce79c-be81-435b-8629-86f077d21fac tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 27760 microversion: 2.20 time: 0.130495 Aug 07 04:55:15.552146 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 130/258] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:55:15 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 27760 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:55:15.989272 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-67990ccf-32d6-4f68-8142-33c777350003 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:15.989846 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-67990ccf-32d6-4f68-8142-33c777350003 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:15.996729 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-67990ccf-32d6-4f68-8142-33c777350003 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:15.997197 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-67990ccf-32d6-4f68-8142-33c777350003 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:15.998006 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-67990ccf-32d6-4f68-8142-33c777350003 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:15.998501 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-67990ccf-32d6-4f68-8142-33c777350003 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:16.125754 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-67990ccf-32d6-4f68-8142-33c777350003 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:16.132898 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-67990ccf-32d6-4f68-8142-33c777350003 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1523 microversion: 2.1 time: 0.147303 Aug 07 04:55:16.133456 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 129/259] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:15 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1523 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:55:16.564841 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-c59663de-63b5-470a-9553-fd7a507b1b86 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:55:16.565849 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-c59663de-63b5-470a-9553-fd7a507b1b86 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:16.572783 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c59663de-63b5-470a-9553-fd7a507b1b86 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:16.573876 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c59663de-63b5-470a-9553-fd7a507b1b86 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:16.574650 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c59663de-63b5-470a-9553-fd7a507b1b86 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:16.575085 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c59663de-63b5-470a-9553-fd7a507b1b86 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:16.961396 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-c59663de-63b5-470a-9553-fd7a507b1b86 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 27910 microversion: 2.20 time: 0.401203 Aug 07 04:55:16.962067 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 131/260] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:55:16 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 27910 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:55:17.150332 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-5c3058fc-a12b-4a45-b591-f20894d2d5c9 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:17.151533 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-5c3058fc-a12b-4a45-b591-f20894d2d5c9 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:17.157678 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5c3058fc-a12b-4a45-b591-f20894d2d5c9 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:17.158264 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5c3058fc-a12b-4a45-b591-f20894d2d5c9 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:17.159216 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5c3058fc-a12b-4a45-b591-f20894d2d5c9 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:17.159726 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5c3058fc-a12b-4a45-b591-f20894d2d5c9 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:17.317212 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-5c3058fc-a12b-4a45-b591-f20894d2d5c9 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:17.325126 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-5c3058fc-a12b-4a45-b591-f20894d2d5c9 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1523 microversion: 2.1 time: 0.178314 Aug 07 04:55:17.325691 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 130/261] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:17 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1523 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:55:17.919019 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-c5c82d90-5d71-48e7-b354-d2845ee95b74 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:17.919702 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-c5c82d90-5d71-48e7-b354-d2845ee95b74 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] [instance: ebbb4a6b-6863-4efc-8e24-5073fcf14368] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:17.926110 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c5c82d90-5d71-48e7-b354-d2845ee95b74 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:17.926773 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c5c82d90-5d71-48e7-b354-d2845ee95b74 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:17.927602 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c5c82d90-5d71-48e7-b354-d2845ee95b74 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:17.928140 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c5c82d90-5d71-48e7-b354-d2845ee95b74 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:17.954788 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-c5c82d90-5d71-48e7-b354-d2845ee95b74 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] [instance: ebbb4a6b-6863-4efc-8e24-5073fcf14368] Going to try to terminate instance {{(pid=107486) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 07 04:55:17.974077 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-a67e9479-19e2-4c64-830e-d920fb86f5da tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:55:17.975291 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-a67e9479-19e2-4c64-830e-d920fb86f5da tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:17.982369 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a67e9479-19e2-4c64-830e-d920fb86f5da tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:17.983046 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a67e9479-19e2-4c64-830e-d920fb86f5da tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:17.983810 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a67e9479-19e2-4c64-830e-d920fb86f5da tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:17.984396 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a67e9479-19e2-4c64-830e-d920fb86f5da tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:18.045139 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-c5c82d90-5d71-48e7-b354-d2845ee95b74 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] 10.222.0.35 "DELETE /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368" status: 204 len: 0 microversion: 2.1 time: 0.130997 Aug 07 04:55:18.046025 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 132/262] 10.222.0.35 () {58 vars in 1239 bytes} [Sat Aug 7 04:55:17 2021] DELETE /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 04:55:18.054542 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-c9abdb64-d663-4cf4-9c5d-006a36ee3b26 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:18.055243 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-c9abdb64-d663-4cf4-9c5d-006a36ee3b26 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] [instance: ebbb4a6b-6863-4efc-8e24-5073fcf14368] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:18.062102 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c9abdb64-d663-4cf4-9c5d-006a36ee3b26 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:18.062628 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c9abdb64-d663-4cf4-9c5d-006a36ee3b26 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:18.063512 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c9abdb64-d663-4cf4-9c5d-006a36ee3b26 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:18.063951 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c9abdb64-d663-4cf4-9c5d-006a36ee3b26 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:18.202607 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-c9abdb64-d663-4cf4-9c5d-006a36ee3b26 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa958efbec43feaf2a6341496d7eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbad771114b14d1c813e85f39291b826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:18.210801 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-c9abdb64-d663-4cf4-9c5d-006a36ee3b26 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] 10.222.0.35 "GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368" status: 200 len: 1553 microversion: 2.1 time: 0.160654 Aug 07 04:55:18.211359 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 133/263] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:18 2021] GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368 => generated 1553 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:55:18.344235 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-849caf08-06d5-401f-9152-44f98586ef19 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:18.344969 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-849caf08-06d5-401f-9152-44f98586ef19 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:18.351699 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-849caf08-06d5-401f-9152-44f98586ef19 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:18.352143 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-849caf08-06d5-401f-9152-44f98586ef19 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:18.352945 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-849caf08-06d5-401f-9152-44f98586ef19 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:18.353377 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-849caf08-06d5-401f-9152-44f98586ef19 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:18.480023 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-849caf08-06d5-401f-9152-44f98586ef19 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:18.487434 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-849caf08-06d5-401f-9152-44f98586ef19 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1523 microversion: 2.1 time: 0.148748 Aug 07 04:55:18.488083 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 134/264] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:18 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:55:19.229126 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-84a987bf-e794-4b57-97d6-29a63f115c41 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:19.229884 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-84a987bf-e794-4b57-97d6-29a63f115c41 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] [instance: ebbb4a6b-6863-4efc-8e24-5073fcf14368] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:19.236552 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-84a987bf-e794-4b57-97d6-29a63f115c41 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:19.237021 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-84a987bf-e794-4b57-97d6-29a63f115c41 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:19.237801 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-84a987bf-e794-4b57-97d6-29a63f115c41 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:19.238227 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-84a987bf-e794-4b57-97d6-29a63f115c41 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:19.364125 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-84a987bf-e794-4b57-97d6-29a63f115c41 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa958efbec43feaf2a6341496d7eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbad771114b14d1c813e85f39291b826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:19.372397 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-84a987bf-e794-4b57-97d6-29a63f115c41 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] 10.222.0.35 "GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368" status: 200 len: 1553 microversion: 2.1 time: 0.147038 Aug 07 04:55:19.372991 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 135/265] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:19 2021] GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368 => generated 1553 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:55:19.503998 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-ce4f0dcb-c986-4cd7-8893-98b81a58bbc1 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:19.504707 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-ce4f0dcb-c986-4cd7-8893-98b81a58bbc1 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:19.510692 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ce4f0dcb-c986-4cd7-8893-98b81a58bbc1 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:19.511324 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ce4f0dcb-c986-4cd7-8893-98b81a58bbc1 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:19.512106 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ce4f0dcb-c986-4cd7-8893-98b81a58bbc1 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:19.512610 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ce4f0dcb-c986-4cd7-8893-98b81a58bbc1 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:19.684760 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-ce4f0dcb-c986-4cd7-8893-98b81a58bbc1 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:19.692217 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-ce4f0dcb-c986-4cd7-8893-98b81a58bbc1 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1523 microversion: 2.1 time: 0.191793 Aug 07 04:55:19.693338 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 136/266] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:19 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1523 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:55:20.390732 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-87319691-ef02-45f7-9ae7-e2904f57d2b4 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:20.391346 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-87319691-ef02-45f7-9ae7-e2904f57d2b4 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] [instance: ebbb4a6b-6863-4efc-8e24-5073fcf14368] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:20.397239 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-87319691-ef02-45f7-9ae7-e2904f57d2b4 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:20.397691 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-87319691-ef02-45f7-9ae7-e2904f57d2b4 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:20.398468 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-87319691-ef02-45f7-9ae7-e2904f57d2b4 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:20.398906 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-87319691-ef02-45f7-9ae7-e2904f57d2b4 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:20.521836 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-87319691-ef02-45f7-9ae7-e2904f57d2b4 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa958efbec43feaf2a6341496d7eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbad771114b14d1c813e85f39291b826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:20.529822 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-87319691-ef02-45f7-9ae7-e2904f57d2b4 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] 10.222.0.35 "GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368" status: 200 len: 1553 microversion: 2.1 time: 0.143473 Aug 07 04:55:20.530402 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 137/267] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:20 2021] GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368 => generated 1553 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:55:20.714165 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-24ec13af-52e1-4947-a479-aa708c165395 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:20.714868 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-24ec13af-52e1-4947-a479-aa708c165395 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:20.721752 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-24ec13af-52e1-4947-a479-aa708c165395 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:20.722187 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-24ec13af-52e1-4947-a479-aa708c165395 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:20.723144 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-24ec13af-52e1-4947-a479-aa708c165395 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:20.723579 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-24ec13af-52e1-4947-a479-aa708c165395 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:20.844607 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-a67e9479-19e2-4c64-830e-d920fb86f5da tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 28059 microversion: 2.20 time: 2.874100 Aug 07 04:55:20.845852 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 131/268] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:55:17 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 28059 bytes in 2876 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 07 04:55:20.855603 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-24ec13af-52e1-4947-a479-aa708c165395 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:20.863223 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-24ec13af-52e1-4947-a479-aa708c165395 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1523 microversion: 2.1 time: 0.153265 Aug 07 04:55:20.873689 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 138/269] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:20 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:55:21.547707 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-ea1f230b-e0da-47dd-b9a5-a4d48f4bb295 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:21.548310 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-ea1f230b-e0da-47dd-b9a5-a4d48f4bb295 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] [instance: ebbb4a6b-6863-4efc-8e24-5073fcf14368] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:21.554716 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ea1f230b-e0da-47dd-b9a5-a4d48f4bb295 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:21.555167 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ea1f230b-e0da-47dd-b9a5-a4d48f4bb295 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:21.555927 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ea1f230b-e0da-47dd-b9a5-a4d48f4bb295 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:21.556358 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ea1f230b-e0da-47dd-b9a5-a4d48f4bb295 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:21.689840 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-ea1f230b-e0da-47dd-b9a5-a4d48f4bb295 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa958efbec43feaf2a6341496d7eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbad771114b14d1c813e85f39291b826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:21.698005 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-ea1f230b-e0da-47dd-b9a5-a4d48f4bb295 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] 10.222.0.35 "GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368" status: 200 len: 1553 microversion: 2.1 time: 0.154286 Aug 07 04:55:21.698768 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 132/270] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:21 2021] GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368 => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:55:21.857166 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-5a02ee0e-da6e-45ec-8516-82bf321f61f2 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:55:21.859101 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-5a02ee0e-da6e-45ec-8516-82bf321f61f2 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:21.868000 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5a02ee0e-da6e-45ec-8516-82bf321f61f2 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:21.868457 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5a02ee0e-da6e-45ec-8516-82bf321f61f2 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:21.869247 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5a02ee0e-da6e-45ec-8516-82bf321f61f2 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:21.869683 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5a02ee0e-da6e-45ec-8516-82bf321f61f2 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:21.880753 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-18f21a89-0991-4f20-838d-98ea1222c20e tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:21.881444 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-18f21a89-0991-4f20-838d-98ea1222c20e tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:21.888329 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-18f21a89-0991-4f20-838d-98ea1222c20e tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:21.888760 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-18f21a89-0991-4f20-838d-98ea1222c20e tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:21.889545 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-18f21a89-0991-4f20-838d-98ea1222c20e tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:21.889970 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-18f21a89-0991-4f20-838d-98ea1222c20e tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:21.997073 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-5a02ee0e-da6e-45ec-8516-82bf321f61f2 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 28175 microversion: 2.20 time: 0.143169 Aug 07 04:55:21.997875 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 139/271] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:55:21 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 28175 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:55:22.028952 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-18f21a89-0991-4f20-838d-98ea1222c20e tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:22.036775 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-18f21a89-0991-4f20-838d-98ea1222c20e tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1523 microversion: 2.1 time: 0.159806 Aug 07 04:55:22.037372 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 133/272] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:21 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:55:22.719381 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-571aba1f-a3f8-489f-a89b-803f2c773091 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:22.720067 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-571aba1f-a3f8-489f-a89b-803f2c773091 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] [instance: ebbb4a6b-6863-4efc-8e24-5073fcf14368] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:22.726619 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-571aba1f-a3f8-489f-a89b-803f2c773091 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:22.727059 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-571aba1f-a3f8-489f-a89b-803f2c773091 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:22.727809 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-571aba1f-a3f8-489f-a89b-803f2c773091 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:22.728233 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-571aba1f-a3f8-489f-a89b-803f2c773091 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:22.867028 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-571aba1f-a3f8-489f-a89b-803f2c773091 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa958efbec43feaf2a6341496d7eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbad771114b14d1c813e85f39291b826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:22.876842 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-571aba1f-a3f8-489f-a89b-803f2c773091 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] 10.222.0.35 "GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368" status: 200 len: 1553 microversion: 2.1 time: 0.161618 Aug 07 04:55:22.880614 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 140/273] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:22 2021] GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368 => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:55:22.907852 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-3be58747-5d5e-4d13-a882-bc86df8acfeb tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2047734439", "imageRef": "ddcf95b5-3ea4-4a61-8f54-4b2feadb8682", "flavorRef": "452", "networks": [{"uuid": "a75033fe-395c-44bd-aeca-8b2f84f00266"}]}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:55:22.963845 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.network.neutron [None req-3be58747-5d5e-4d13-a882-bc86df8acfeb tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] validate_networks() for [('a75033fe-395c-44bd-aeca-8b2f84f00266', None, None, None)] {{(pid=107485) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 07 04:55:23.010446 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-0a1ec0c1-74dc-41a6-8dc1-bec2fdd44e34 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:55:23.011562 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-0a1ec0c1-74dc-41a6-8dc1-bec2fdd44e34 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:23.020296 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0a1ec0c1-74dc-41a6-8dc1-bec2fdd44e34 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:23.020992 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0a1ec0c1-74dc-41a6-8dc1-bec2fdd44e34 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:23.021973 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0a1ec0c1-74dc-41a6-8dc1-bec2fdd44e34 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:23.022222 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0a1ec0c1-74dc-41a6-8dc1-bec2fdd44e34 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:23.187913 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-0a1ec0c1-74dc-41a6-8dc1-bec2fdd44e34 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 28175 microversion: 2.20 time: 0.181688 Aug 07 04:55:23.189511 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 141/274] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:55:23 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 28175 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 07 04:55:23.198371 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-76d92fa1-e8af-453c-b7a3-8b88a50880e8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:23.199297 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-76d92fa1-e8af-453c-b7a3-8b88a50880e8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:23.207967 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-76d92fa1-e8af-453c-b7a3-8b88a50880e8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:23.209419 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-76d92fa1-e8af-453c-b7a3-8b88a50880e8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:23.210280 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-76d92fa1-e8af-453c-b7a3-8b88a50880e8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:23.210849 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-76d92fa1-e8af-453c-b7a3-8b88a50880e8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:23.363010 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.virt.hardware [None req-3be58747-5d5e-4d13-a882-bc86df8acfeb tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Flavor limits 0:0:0 {{(pid=107485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 04:55:23.363590 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.virt.hardware [None req-3be58747-5d5e-4d13-a882-bc86df8acfeb tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Image limits 0:0:0 {{(pid=107485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 04:55:23.364362 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.virt.hardware [None req-3be58747-5d5e-4d13-a882-bc86df8acfeb tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Flavor pref 0:0:0 {{(pid=107485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 04:55:23.364952 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.virt.hardware [None req-3be58747-5d5e-4d13-a882-bc86df8acfeb tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Image pref 0:0:0 {{(pid=107485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 04:55:23.365463 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.virt.hardware [None req-3be58747-5d5e-4d13-a882-bc86df8acfeb tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 04:55:23.376184 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3be58747-5d5e-4d13-a882-bc86df8acfeb tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:23.376712 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3be58747-5d5e-4d13-a882-bc86df8acfeb tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:23.377620 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3be58747-5d5e-4d13-a882-bc86df8acfeb tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:23.378141 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3be58747-5d5e-4d13-a882-bc86df8acfeb tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:23.395121 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.quota [None req-3be58747-5d5e-4d13-a882-bc86df8acfeb tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Getting quotas for project 910b734a3aa343fb9c79c6f1ae1ed425. Resources: {'ram', 'cores', 'instances'} {{(pid=107485) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 07 04:55:23.400119 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.quota [None req-3be58747-5d5e-4d13-a882-bc86df8acfeb tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Getting quotas for user e9a41fbfb1db4c2c8bb0c9ef8020a4b3 and project 910b734a3aa343fb9c79c6f1ae1ed425. Resources: {'ram', 'cores', 'instances'} {{(pid=107485) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 07 04:55:23.404406 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-76d92fa1-e8af-453c-b7a3-8b88a50880e8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:23.412168 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-3be58747-5d5e-4d13-a882-bc86df8acfeb tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Going to run 1 instances... {{(pid=107485) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 07 04:55:23.414647 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-3be58747-5d5e-4d13-a882-bc86df8acfeb tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] [instance: 9a4ce309-bcca-4504-9c88-5c183528a8f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ddcf95b5-3ea4-4a61-8f54-4b2feadb8682',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107485) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 07 04:55:23.416764 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-76d92fa1-e8af-453c-b7a3-8b88a50880e8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1523 microversion: 2.1 time: 0.224917 Aug 07 04:55:23.419011 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 142/275] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:23 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1523 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:55:23.467778 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-3be58747-5d5e-4d13-a882-bc86df8acfeb tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.563378 Aug 07 04:55:23.468881 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 134/276] 10.222.0.35 () {60 vars in 1147 bytes} [Sat Aug 7 04:55:22 2021] POST /compute/v2.1/servers => generated 380 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 04:55:23.485373 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-813d01ae-f579-48b2-8a1d-41068b06ad24 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:23.485978 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-813d01ae-f579-48b2-8a1d-41068b06ad24 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] [instance: 9a4ce309-bcca-4504-9c88-5c183528a8f8] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:23.596230 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-813d01ae-f579-48b2-8a1d-41068b06ad24 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a41fbfb1db4c2c8bb0c9ef8020a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910b734a3aa343fb9c79c6f1ae1ed425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:23.604738 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-813d01ae-f579-48b2-8a1d-41068b06ad24 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] 10.222.0.35 "GET /compute/v2.1/servers/9a4ce309-bcca-4504-9c88-5c183528a8f8" status: 200 len: 1214 microversion: 2.1 time: 0.121726 Aug 07 04:55:23.608810 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 143/277] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:23 2021] GET /compute/v2.1/servers/9a4ce309-bcca-4504-9c88-5c183528a8f8 => generated 1214 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:55:23.893927 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-b91e8f13-c17d-42ef-a44d-64dc582dd27c tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:23.895197 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-b91e8f13-c17d-42ef-a44d-64dc582dd27c tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] [instance: ebbb4a6b-6863-4efc-8e24-5073fcf14368] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:23.901552 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b91e8f13-c17d-42ef-a44d-64dc582dd27c tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:23.902105 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b91e8f13-c17d-42ef-a44d-64dc582dd27c tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:23.903127 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b91e8f13-c17d-42ef-a44d-64dc582dd27c tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:23.903644 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b91e8f13-c17d-42ef-a44d-64dc582dd27c tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:24.037306 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-b91e8f13-c17d-42ef-a44d-64dc582dd27c tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa958efbec43feaf2a6341496d7eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbad771114b14d1c813e85f39291b826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:24.045525 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-b91e8f13-c17d-42ef-a44d-64dc582dd27c tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] 10.222.0.35 "GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368" status: 200 len: 1553 microversion: 2.1 time: 0.155854 Aug 07 04:55:24.046095 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 135/278] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:23 2021] GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368 => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:55:24.201203 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-f1d291be-091b-47ca-a946-53a8405e96c1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:55:24.202191 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-f1d291be-091b-47ca-a946-53a8405e96c1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:24.209187 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f1d291be-091b-47ca-a946-53a8405e96c1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:24.209699 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f1d291be-091b-47ca-a946-53a8405e96c1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:24.210764 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f1d291be-091b-47ca-a946-53a8405e96c1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:24.211371 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f1d291be-091b-47ca-a946-53a8405e96c1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:24.317132 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-f1d291be-091b-47ca-a946-53a8405e96c1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 28175 microversion: 2.20 time: 0.120754 Aug 07 04:55:24.318420 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 144/279] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:55:24 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 28175 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:55:24.482320 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-634545e0-9048-425c-9ccd-13d4dfbd656c tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:24.482932 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-634545e0-9048-425c-9ccd-13d4dfbd656c tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:24.489065 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-634545e0-9048-425c-9ccd-13d4dfbd656c tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:24.489508 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-634545e0-9048-425c-9ccd-13d4dfbd656c tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:24.490318 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-634545e0-9048-425c-9ccd-13d4dfbd656c tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:24.490750 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-634545e0-9048-425c-9ccd-13d4dfbd656c tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:24.625439 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-c3a3ebdb-843e-4f4e-8e5f-79c5528087ae tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:24.626499 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-c3a3ebdb-843e-4f4e-8e5f-79c5528087ae tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] [instance: 9a4ce309-bcca-4504-9c88-5c183528a8f8] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:24.637338 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-634545e0-9048-425c-9ccd-13d4dfbd656c tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:24.639914 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c3a3ebdb-843e-4f4e-8e5f-79c5528087ae tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:24.640607 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c3a3ebdb-843e-4f4e-8e5f-79c5528087ae tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:24.641782 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c3a3ebdb-843e-4f4e-8e5f-79c5528087ae tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:24.642788 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c3a3ebdb-843e-4f4e-8e5f-79c5528087ae tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:24.646252 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-634545e0-9048-425c-9ccd-13d4dfbd656c tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1523 microversion: 2.1 time: 0.167893 Aug 07 04:55:24.647420 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 136/280] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:24 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:55:24.739300 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-c3a3ebdb-843e-4f4e-8e5f-79c5528087ae tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a41fbfb1db4c2c8bb0c9ef8020a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910b734a3aa343fb9c79c6f1ae1ed425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:24.750327 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-c3a3ebdb-843e-4f4e-8e5f-79c5528087ae tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] 10.222.0.35 "GET /compute/v2.1/servers/9a4ce309-bcca-4504-9c88-5c183528a8f8" status: 200 len: 1266 microversion: 2.1 time: 0.131475 Aug 07 04:55:24.751499 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 145/281] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:24 2021] GET /compute/v2.1/servers/9a4ce309-bcca-4504-9c88-5c183528a8f8 => generated 1266 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:55:25.055478 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [req-808e00e2-436d-497b-8a45-d987fbab6b43 req-881bab51-c2ea-42a9-99ec-080fa81b5ccf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebbb4a6b-6863-4efc-8e24-5073fcf14368", "name": "network-vif-deleted", "tag": "1b5eb467-65ff-42a9-ae4a-da9f4bbed5d1"}]} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:55:25.064654 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-583c67fa-e5de-4b93-bb03-05e301863ff9 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:25.065017 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 04:55:25.065017 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: warnings.warn(msg) Aug 07 04:55:25.065405 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-583c67fa-e5de-4b93-bb03-05e301863ff9 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] [instance: ebbb4a6b-6863-4efc-8e24-5073fcf14368] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:25.072731 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-808e00e2-436d-497b-8a45-d987fbab6b43 req-881bab51-c2ea-42a9-99ec-080fa81b5ccf service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:25.075712 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-808e00e2-436d-497b-8a45-d987fbab6b43 req-881bab51-c2ea-42a9-99ec-080fa81b5ccf service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:25.077384 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-583c67fa-e5de-4b93-bb03-05e301863ff9 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:25.077910 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-583c67fa-e5de-4b93-bb03-05e301863ff9 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:25.080038 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-583c67fa-e5de-4b93-bb03-05e301863ff9 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:25.080534 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-583c67fa-e5de-4b93-bb03-05e301863ff9 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:25.089032 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.compute.server_external_events [req-808e00e2-436d-497b-8a45-d987fbab6b43 req-881bab51-c2ea-42a9-99ec-080fa81b5ccf service nova] Creating event network-vif-deleted:1b5eb467-65ff-42a9-ae4a-da9f4bbed5d1 for instance ebbb4a6b-6863-4efc-8e24-5073fcf14368 on hv-cinder-80374 Aug 07 04:55:25.095685 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [req-808e00e2-436d-497b-8a45-d987fbab6b43 req-881bab51-c2ea-42a9-99ec-080fa81b5ccf service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046138 Aug 07 04:55:25.101119 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 137/282] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 04:55:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:55:25.175296 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-583c67fa-e5de-4b93-bb03-05e301863ff9 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa958efbec43feaf2a6341496d7eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbad771114b14d1c813e85f39291b826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:25.185901 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-583c67fa-e5de-4b93-bb03-05e301863ff9 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] 10.222.0.35 "GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368" status: 200 len: 1511 microversion: 2.1 time: 0.126745 Aug 07 04:55:25.187058 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 146/283] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:25 2021] GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368 => generated 1511 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:55:25.329540 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-f5f1c9dc-cbf5-486e-9e31-b6b7c36a6983 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:55:25.330536 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-f5f1c9dc-cbf5-486e-9e31-b6b7c36a6983 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:25.336666 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f5f1c9dc-cbf5-486e-9e31-b6b7c36a6983 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:25.337160 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f5f1c9dc-cbf5-486e-9e31-b6b7c36a6983 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:25.337942 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f5f1c9dc-cbf5-486e-9e31-b6b7c36a6983 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:25.338920 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f5f1c9dc-cbf5-486e-9e31-b6b7c36a6983 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:25.498208 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-f5f1c9dc-cbf5-486e-9e31-b6b7c36a6983 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 28175 microversion: 2.20 time: 0.172444 Aug 07 04:55:25.499101 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 138/284] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:55:25 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 28175 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:55:25.664019 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-531a2b34-ffa3-478a-b85c-5976c66b14ef tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:25.664769 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-531a2b34-ffa3-478a-b85c-5976c66b14ef tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:25.674799 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-531a2b34-ffa3-478a-b85c-5976c66b14ef tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:25.676335 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-531a2b34-ffa3-478a-b85c-5976c66b14ef tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:25.676497 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-531a2b34-ffa3-478a-b85c-5976c66b14ef tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:25.676814 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-531a2b34-ffa3-478a-b85c-5976c66b14ef tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:25.768559 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-9678f3f9-e282-4705-9c42-d3868d08b262 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:25.769348 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-9678f3f9-e282-4705-9c42-d3868d08b262 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] [instance: 9a4ce309-bcca-4504-9c88-5c183528a8f8] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:25.783325 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9678f3f9-e282-4705-9c42-d3868d08b262 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:25.783856 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9678f3f9-e282-4705-9c42-d3868d08b262 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:25.784857 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9678f3f9-e282-4705-9c42-d3868d08b262 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:25.785470 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9678f3f9-e282-4705-9c42-d3868d08b262 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:25.821108 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-531a2b34-ffa3-478a-b85c-5976c66b14ef tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:25.829882 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-531a2b34-ffa3-478a-b85c-5976c66b14ef tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1523 microversion: 2.1 time: 0.170188 Aug 07 04:55:25.830739 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 147/285] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:25 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:55:25.868394 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-9678f3f9-e282-4705-9c42-d3868d08b262 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a41fbfb1db4c2c8bb0c9ef8020a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910b734a3aa343fb9c79c6f1ae1ed425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:25.876198 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-9678f3f9-e282-4705-9c42-d3868d08b262 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] 10.222.0.35 "GET /compute/v2.1/servers/9a4ce309-bcca-4504-9c88-5c183528a8f8" status: 200 len: 1272 microversion: 2.1 time: 0.111751 Aug 07 04:55:25.876663 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 139/286] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:25 2021] GET /compute/v2.1/servers/9a4ce309-bcca-4504-9c88-5c183528a8f8 => generated 1272 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:55:26.203363 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-9dace383-97bd-4194-8827-a21bfe048cdd tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:26.203973 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-9dace383-97bd-4194-8827-a21bfe048cdd tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] [instance: ebbb4a6b-6863-4efc-8e24-5073fcf14368] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:26.210033 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9dace383-97bd-4194-8827-a21bfe048cdd tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:26.210302 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9dace383-97bd-4194-8827-a21bfe048cdd tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:26.211106 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9dace383-97bd-4194-8827-a21bfe048cdd tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:26.211535 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9dace383-97bd-4194-8827-a21bfe048cdd tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:26.248051 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9dace383-97bd-4194-8827-a21bfe048cdd tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:26.248496 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9dace383-97bd-4194-8827-a21bfe048cdd tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:26.248964 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.objects.instance [None req-9dace383-97bd-4194-8827-a21bfe048cdd tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lazy-loading 'fault' on Instance uuid ebbb4a6b-6863-4efc-8e24-5073fcf14368 {{(pid=107486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 04:55:26.303035 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-9dace383-97bd-4194-8827-a21bfe048cdd tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa958efbec43feaf2a6341496d7eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbad771114b14d1c813e85f39291b826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:26.312544 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-9dace383-97bd-4194-8827-a21bfe048cdd tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] 10.222.0.35 "GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368" status: 200 len: 1351 microversion: 2.1 time: 0.112869 Aug 07 04:55:26.313640 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 148/287] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:26 2021] GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368 => generated 1351 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:55:26.512396 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-35d21493-4ea0-4508-b87b-91344c5d6f89 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:55:26.513355 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-35d21493-4ea0-4508-b87b-91344c5d6f89 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:26.519474 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-35d21493-4ea0-4508-b87b-91344c5d6f89 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:26.521136 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-35d21493-4ea0-4508-b87b-91344c5d6f89 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:26.522299 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-35d21493-4ea0-4508-b87b-91344c5d6f89 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:26.522950 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-35d21493-4ea0-4508-b87b-91344c5d6f89 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:26.847566 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-c19df376-2fda-48f2-ae30-ee1738170174 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:26.848104 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-c19df376-2fda-48f2-ae30-ee1738170174 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:26.854689 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c19df376-2fda-48f2-ae30-ee1738170174 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:26.855125 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c19df376-2fda-48f2-ae30-ee1738170174 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:26.856703 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c19df376-2fda-48f2-ae30-ee1738170174 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:26.858220 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c19df376-2fda-48f2-ae30-ee1738170174 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:27.001304 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-c19df376-2fda-48f2-ae30-ee1738170174 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:27.012308 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-c19df376-2fda-48f2-ae30-ee1738170174 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1523 microversion: 2.1 time: 0.168697 Aug 07 04:55:27.013381 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 149/288] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:26 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:55:27.025027 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-bfbceb3e-a9a4-4c97-85dd-f2a54c167c7a tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:27.026187 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-bfbceb3e-a9a4-4c97-85dd-f2a54c167c7a tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] [instance: 9a4ce309-bcca-4504-9c88-5c183528a8f8] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:27.033195 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-bfbceb3e-a9a4-4c97-85dd-f2a54c167c7a tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:27.033642 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-bfbceb3e-a9a4-4c97-85dd-f2a54c167c7a tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:27.034409 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-bfbceb3e-a9a4-4c97-85dd-f2a54c167c7a tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:27.034995 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-bfbceb3e-a9a4-4c97-85dd-f2a54c167c7a tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:27.193083 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-bfbceb3e-a9a4-4c97-85dd-f2a54c167c7a tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a41fbfb1db4c2c8bb0c9ef8020a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910b734a3aa343fb9c79c6f1ae1ed425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:27.201721 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-bfbceb3e-a9a4-4c97-85dd-f2a54c167c7a tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] 10.222.0.35 "GET /compute/v2.1/servers/9a4ce309-bcca-4504-9c88-5c183528a8f8" status: 200 len: 1314 microversion: 2.1 time: 0.186992 Aug 07 04:55:27.202655 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 150/289] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:27 2021] GET /compute/v2.1/servers/9a4ce309-bcca-4504-9c88-5c183528a8f8 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:55:27.207755 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [req-f68c034e-769d-4581-9ed0-fb5ab808feb2 req-b4dfba92-e9e1-4978-950e-e88683c01993 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a4ce309-bcca-4504-9c88-5c183528a8f8", "tag": "337a0ff1-4895-4bdd-89c0-fa8596538184"}]} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:55:27.209721 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 04:55:27.209721 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: warnings.warn(msg) Aug 07 04:55:27.219173 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-f68c034e-769d-4581-9ed0-fb5ab808feb2 req-b4dfba92-e9e1-4978-950e-e88683c01993 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:27.219601 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-f68c034e-769d-4581-9ed0-fb5ab808feb2 req-b4dfba92-e9e1-4978-950e-e88683c01993 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:27.230552 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.compute.server_external_events [req-f68c034e-769d-4581-9ed0-fb5ab808feb2 req-b4dfba92-e9e1-4978-950e-e88683c01993 service nova] Creating event network-changed:337a0ff1-4895-4bdd-89c0-fa8596538184 for instance 9a4ce309-bcca-4504-9c88-5c183528a8f8 on hv-cinder-80374 Aug 07 04:55:27.235395 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [req-f68c034e-769d-4581-9ed0-fb5ab808feb2 req-b4dfba92-e9e1-4978-950e-e88683c01993 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031218 Aug 07 04:55:27.236176 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 151/290] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 04:55:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:55:27.330869 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-f87e40c8-665b-47d1-8851-d0c27aa0c913 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:27.331775 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-f87e40c8-665b-47d1-8851-d0c27aa0c913 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] [instance: ebbb4a6b-6863-4efc-8e24-5073fcf14368] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:27.341104 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f87e40c8-665b-47d1-8851-d0c27aa0c913 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:27.341733 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f87e40c8-665b-47d1-8851-d0c27aa0c913 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:27.343146 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f87e40c8-665b-47d1-8851-d0c27aa0c913 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:27.343729 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f87e40c8-665b-47d1-8851-d0c27aa0c913 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:27.380941 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f87e40c8-665b-47d1-8851-d0c27aa0c913 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:27.381384 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f87e40c8-665b-47d1-8851-d0c27aa0c913 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:27.381824 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.objects.instance [None req-f87e40c8-665b-47d1-8851-d0c27aa0c913 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lazy-loading 'fault' on Instance uuid ebbb4a6b-6863-4efc-8e24-5073fcf14368 {{(pid=107486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 04:55:27.425456 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-f87e40c8-665b-47d1-8851-d0c27aa0c913 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa958efbec43feaf2a6341496d7eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbad771114b14d1c813e85f39291b826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:27.434238 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-f87e40c8-665b-47d1-8851-d0c27aa0c913 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] 10.222.0.35 "GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368" status: 200 len: 1351 microversion: 2.1 time: 0.108271 Aug 07 04:55:27.434884 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 152/291] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:27 2021] GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368 => generated 1351 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:55:28.029842 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-098325ac-2831-499a-9d42-82be061f84f7 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:28.030462 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-098325ac-2831-499a-9d42-82be061f84f7 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:28.036722 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-098325ac-2831-499a-9d42-82be061f84f7 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:28.037217 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-098325ac-2831-499a-9d42-82be061f84f7 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:28.037997 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-098325ac-2831-499a-9d42-82be061f84f7 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:28.038438 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-098325ac-2831-499a-9d42-82be061f84f7 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:28.160710 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-098325ac-2831-499a-9d42-82be061f84f7 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:28.168540 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-098325ac-2831-499a-9d42-82be061f84f7 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1523 microversion: 2.1 time: 0.143065 Aug 07 04:55:28.169142 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 153/292] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:28 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1523 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:55:28.221826 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-24b9e0f2-fa46-41dd-9577-f2e80301adef tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:28.222439 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-24b9e0f2-fa46-41dd-9577-f2e80301adef tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] [instance: 9a4ce309-bcca-4504-9c88-5c183528a8f8] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:28.228221 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-24b9e0f2-fa46-41dd-9577-f2e80301adef tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:28.229238 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-24b9e0f2-fa46-41dd-9577-f2e80301adef tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:28.231460 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-24b9e0f2-fa46-41dd-9577-f2e80301adef tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:28.231900 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-24b9e0f2-fa46-41dd-9577-f2e80301adef tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:28.359087 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-24b9e0f2-fa46-41dd-9577-f2e80301adef tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a41fbfb1db4c2c8bb0c9ef8020a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910b734a3aa343fb9c79c6f1ae1ed425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:28.366279 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-24b9e0f2-fa46-41dd-9577-f2e80301adef tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] 10.222.0.35 "GET /compute/v2.1/servers/9a4ce309-bcca-4504-9c88-5c183528a8f8" status: 200 len: 1314 microversion: 2.1 time: 0.148365 Aug 07 04:55:28.366826 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 154/293] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:28 2021] GET /compute/v2.1/servers/9a4ce309-bcca-4504-9c88-5c183528a8f8 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:55:28.451403 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-2f13968a-3fdf-4534-bc4e-934f2405aa54 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:28.452038 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-2f13968a-3fdf-4534-bc4e-934f2405aa54 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] [instance: ebbb4a6b-6863-4efc-8e24-5073fcf14368] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:28.457770 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2f13968a-3fdf-4534-bc4e-934f2405aa54 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:28.458215 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2f13968a-3fdf-4534-bc4e-934f2405aa54 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:28.458977 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2f13968a-3fdf-4534-bc4e-934f2405aa54 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:28.459414 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2f13968a-3fdf-4534-bc4e-934f2405aa54 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:28.491203 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2f13968a-3fdf-4534-bc4e-934f2405aa54 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:28.491644 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2f13968a-3fdf-4534-bc4e-934f2405aa54 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:28.492086 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.objects.instance [None req-2f13968a-3fdf-4534-bc4e-934f2405aa54 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lazy-loading 'fault' on Instance uuid ebbb4a6b-6863-4efc-8e24-5073fcf14368 {{(pid=107486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 04:55:28.530399 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-2f13968a-3fdf-4534-bc4e-934f2405aa54 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa958efbec43feaf2a6341496d7eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbad771114b14d1c813e85f39291b826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:28.538340 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-2f13968a-3fdf-4534-bc4e-934f2405aa54 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] 10.222.0.35 "GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368" status: 200 len: 1351 microversion: 2.1 time: 0.090729 Aug 07 04:55:28.538897 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 155/294] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:28 2021] GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368 => generated 1351 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:55:29.185694 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-e56a7ea6-9543-44b0-a594-73b8190ca2ee tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:29.186469 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-e56a7ea6-9543-44b0-a594-73b8190ca2ee tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:29.192545 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e56a7ea6-9543-44b0-a594-73b8190ca2ee tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:29.193027 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e56a7ea6-9543-44b0-a594-73b8190ca2ee tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:29.193795 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e56a7ea6-9543-44b0-a594-73b8190ca2ee tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:29.194226 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e56a7ea6-9543-44b0-a594-73b8190ca2ee tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:29.323382 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-e56a7ea6-9543-44b0-a594-73b8190ca2ee tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:29.331490 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-e56a7ea6-9543-44b0-a594-73b8190ca2ee tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1523 microversion: 2.1 time: 0.149996 Aug 07 04:55:29.332076 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 156/295] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:29 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:55:29.383188 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-97570c1b-0569-476c-9795-06dbbd2ce19f tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:29.383625 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-97570c1b-0569-476c-9795-06dbbd2ce19f tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] [instance: 9a4ce309-bcca-4504-9c88-5c183528a8f8] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:29.390531 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-97570c1b-0569-476c-9795-06dbbd2ce19f tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:29.391403 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-97570c1b-0569-476c-9795-06dbbd2ce19f tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:29.393217 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-97570c1b-0569-476c-9795-06dbbd2ce19f tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:29.394242 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-97570c1b-0569-476c-9795-06dbbd2ce19f tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:29.529035 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-97570c1b-0569-476c-9795-06dbbd2ce19f tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a41fbfb1db4c2c8bb0c9ef8020a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910b734a3aa343fb9c79c6f1ae1ed425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:29.536879 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-97570c1b-0569-476c-9795-06dbbd2ce19f tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] 10.222.0.35 "GET /compute/v2.1/servers/9a4ce309-bcca-4504-9c88-5c183528a8f8" status: 200 len: 1314 microversion: 2.1 time: 0.157754 Aug 07 04:55:29.537424 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 157/296] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:29 2021] GET /compute/v2.1/servers/9a4ce309-bcca-4504-9c88-5c183528a8f8 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:55:29.554779 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-df74bdbd-cff6-483b-b636-e6b23afbf9a8 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:29.555375 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-df74bdbd-cff6-483b-b636-e6b23afbf9a8 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] [instance: ebbb4a6b-6863-4efc-8e24-5073fcf14368] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:29.561748 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-df74bdbd-cff6-483b-b636-e6b23afbf9a8 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:29.562191 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-df74bdbd-cff6-483b-b636-e6b23afbf9a8 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:29.562951 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-df74bdbd-cff6-483b-b636-e6b23afbf9a8 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:29.563378 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-df74bdbd-cff6-483b-b636-e6b23afbf9a8 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:29.594762 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-df74bdbd-cff6-483b-b636-e6b23afbf9a8 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:29.595204 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-df74bdbd-cff6-483b-b636-e6b23afbf9a8 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:29.595647 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.objects.instance [None req-df74bdbd-cff6-483b-b636-e6b23afbf9a8 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lazy-loading 'fault' on Instance uuid ebbb4a6b-6863-4efc-8e24-5073fcf14368 {{(pid=107486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 04:55:29.639307 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-df74bdbd-cff6-483b-b636-e6b23afbf9a8 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa958efbec43feaf2a6341496d7eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbad771114b14d1c813e85f39291b826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:29.647081 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-df74bdbd-cff6-483b-b636-e6b23afbf9a8 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] 10.222.0.35 "GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368" status: 200 len: 1351 microversion: 2.1 time: 0.095742 Aug 07 04:55:29.647638 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 158/297] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:29 2021] GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368 => generated 1351 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:55:30.348711 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-763444af-1a03-499a-adad-5c2f389562e9 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:30.350690 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-763444af-1a03-499a-adad-5c2f389562e9 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:30.356005 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-763444af-1a03-499a-adad-5c2f389562e9 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:30.356677 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-763444af-1a03-499a-adad-5c2f389562e9 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:30.357587 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-763444af-1a03-499a-adad-5c2f389562e9 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:30.358119 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-763444af-1a03-499a-adad-5c2f389562e9 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:30.486103 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-763444af-1a03-499a-adad-5c2f389562e9 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:30.493534 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-763444af-1a03-499a-adad-5c2f389562e9 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1523 microversion: 2.1 time: 0.148452 Aug 07 04:55:30.494107 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 159/298] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:30 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:55:30.553557 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-9d73f80d-6e63-4827-bc67-6ed38b45a062 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:30.554174 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-9d73f80d-6e63-4827-bc67-6ed38b45a062 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] [instance: 9a4ce309-bcca-4504-9c88-5c183528a8f8] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:30.562521 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9d73f80d-6e63-4827-bc67-6ed38b45a062 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:30.562973 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9d73f80d-6e63-4827-bc67-6ed38b45a062 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:30.563755 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9d73f80d-6e63-4827-bc67-6ed38b45a062 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:30.564190 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9d73f80d-6e63-4827-bc67-6ed38b45a062 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:30.699233 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-9d73f80d-6e63-4827-bc67-6ed38b45a062 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a41fbfb1db4c2c8bb0c9ef8020a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910b734a3aa343fb9c79c6f1ae1ed425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:30.699553 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-35d21493-4ea0-4508-b87b-91344c5d6f89 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 28175 microversion: 2.20 time: 4.191874 Aug 07 04:55:30.700207 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 140/299] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:55:26 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 28175 bytes in 4194 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:55:30.705847 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-0ce89e1d-b689-4023-a1c3-286ebe29159b tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:30.706543 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-0ce89e1d-b689-4023-a1c3-286ebe29159b tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] [instance: ebbb4a6b-6863-4efc-8e24-5073fcf14368] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:30.710213 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-9d73f80d-6e63-4827-bc67-6ed38b45a062 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] 10.222.0.35 "GET /compute/v2.1/servers/9a4ce309-bcca-4504-9c88-5c183528a8f8" status: 200 len: 1314 microversion: 2.1 time: 0.160038 Aug 07 04:55:30.711649 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 160/300] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:30 2021] GET /compute/v2.1/servers/9a4ce309-bcca-4504-9c88-5c183528a8f8 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:55:30.716406 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0ce89e1d-b689-4023-a1c3-286ebe29159b tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:30.716882 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0ce89e1d-b689-4023-a1c3-286ebe29159b tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:30.717665 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0ce89e1d-b689-4023-a1c3-286ebe29159b tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:30.718101 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0ce89e1d-b689-4023-a1c3-286ebe29159b tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:30.751072 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0ce89e1d-b689-4023-a1c3-286ebe29159b tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:30.751528 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0ce89e1d-b689-4023-a1c3-286ebe29159b tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:30.752003 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.objects.instance [None req-0ce89e1d-b689-4023-a1c3-286ebe29159b tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lazy-loading 'fault' on Instance uuid ebbb4a6b-6863-4efc-8e24-5073fcf14368 {{(pid=107485) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 04:55:30.797461 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-0ce89e1d-b689-4023-a1c3-286ebe29159b tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa958efbec43feaf2a6341496d7eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbad771114b14d1c813e85f39291b826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:30.806189 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-0ce89e1d-b689-4023-a1c3-286ebe29159b tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] 10.222.0.35 "GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368" status: 200 len: 1351 microversion: 2.1 time: 0.104447 Aug 07 04:55:30.807470 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 141/301] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:30 2021] GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368 => generated 1351 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:55:31.512774 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-e9f23d3b-d96b-4165-9945-a5a74b3795de tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:31.513841 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-e9f23d3b-d96b-4165-9945-a5a74b3795de tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:31.520220 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e9f23d3b-d96b-4165-9945-a5a74b3795de tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:31.520742 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e9f23d3b-d96b-4165-9945-a5a74b3795de tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:31.521809 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e9f23d3b-d96b-4165-9945-a5a74b3795de tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:31.522316 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e9f23d3b-d96b-4165-9945-a5a74b3795de tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:31.657747 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-e9f23d3b-d96b-4165-9945-a5a74b3795de tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:31.665647 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-e9f23d3b-d96b-4165-9945-a5a74b3795de tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1523 microversion: 2.1 time: 0.157917 Aug 07 04:55:31.666257 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 161/302] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:31 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:55:31.711714 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-61af1070-2b5e-495a-b871-12aa9abaa7ec tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:55:31.712709 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-61af1070-2b5e-495a-b871-12aa9abaa7ec tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:31.719164 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-61af1070-2b5e-495a-b871-12aa9abaa7ec tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:31.719602 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-61af1070-2b5e-495a-b871-12aa9abaa7ec tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:31.720357 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-61af1070-2b5e-495a-b871-12aa9abaa7ec tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:31.720783 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-61af1070-2b5e-495a-b871-12aa9abaa7ec tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:31.727423 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-64a03c21-c1e2-4c5f-a9aa-ccff9474e79f tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:31.728100 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-64a03c21-c1e2-4c5f-a9aa-ccff9474e79f tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] [instance: 9a4ce309-bcca-4504-9c88-5c183528a8f8] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:31.735226 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-64a03c21-c1e2-4c5f-a9aa-ccff9474e79f tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:31.735847 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-64a03c21-c1e2-4c5f-a9aa-ccff9474e79f tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:31.737161 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-64a03c21-c1e2-4c5f-a9aa-ccff9474e79f tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:31.737900 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-64a03c21-c1e2-4c5f-a9aa-ccff9474e79f tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:31.878098 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-64a03c21-c1e2-4c5f-a9aa-ccff9474e79f tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a41fbfb1db4c2c8bb0c9ef8020a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910b734a3aa343fb9c79c6f1ae1ed425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:31.886542 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-64a03c21-c1e2-4c5f-a9aa-ccff9474e79f tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] 10.222.0.35 "GET /compute/v2.1/servers/9a4ce309-bcca-4504-9c88-5c183528a8f8" status: 200 len: 1314 microversion: 2.1 time: 0.162984 Aug 07 04:55:31.887630 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 162/303] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:31 2021] GET /compute/v2.1/servers/9a4ce309-bcca-4504-9c88-5c183528a8f8 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:55:31.892450 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-7e92cd91-8d1f-4f8f-871b-2ce3e2dc3725 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:31.893231 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-7e92cd91-8d1f-4f8f-871b-2ce3e2dc3725 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] [instance: ebbb4a6b-6863-4efc-8e24-5073fcf14368] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:31.899367 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-7e92cd91-8d1f-4f8f-871b-2ce3e2dc3725 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:31.899788 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-7e92cd91-8d1f-4f8f-871b-2ce3e2dc3725 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:31.901249 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-7e92cd91-8d1f-4f8f-871b-2ce3e2dc3725 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:31.901735 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-7e92cd91-8d1f-4f8f-871b-2ce3e2dc3725 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:31.915868 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.wsgi [None req-7e92cd91-8d1f-4f8f-871b-2ce3e2dc3725 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] HTTP exception thrown: Instance ebbb4a6b-6863-4efc-8e24-5073fcf14368 could not be found. Aug 07 04:55:31.916736 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-7e92cd91-8d1f-4f8f-871b-2ce3e2dc3725 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Returning 404 to user: Instance ebbb4a6b-6863-4efc-8e24-5073fcf14368 could not be found. {{(pid=107486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 07 04:55:31.917677 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-7e92cd91-8d1f-4f8f-871b-2ce3e2dc3725 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] 10.222.0.35 "GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368" status: 404 len: 111 microversion: 2.1 time: 0.028802 Aug 07 04:55:31.921392 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 163/304] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:31 2021] GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 04:55:31.949098 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-61af1070-2b5e-495a-b871-12aa9abaa7ec tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 28175 microversion: 2.20 time: 0.240345 Aug 07 04:55:31.949606 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 142/305] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:55:31 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 28175 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:55:32.052805 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-59c5b058-26b8-4dc2-bd4e-ae15dfc3c8f9 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:32.053725 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-59c5b058-26b8-4dc2-bd4e-ae15dfc3c8f9 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] [instance: ebbb4a6b-6863-4efc-8e24-5073fcf14368] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:32.061519 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-59c5b058-26b8-4dc2-bd4e-ae15dfc3c8f9 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:32.062285 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-59c5b058-26b8-4dc2-bd4e-ae15dfc3c8f9 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:32.063286 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-59c5b058-26b8-4dc2-bd4e-ae15dfc3c8f9 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:32.064052 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-59c5b058-26b8-4dc2-bd4e-ae15dfc3c8f9 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:32.078570 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.wsgi [None req-59c5b058-26b8-4dc2-bd4e-ae15dfc3c8f9 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] HTTP exception thrown: Instance ebbb4a6b-6863-4efc-8e24-5073fcf14368 could not be found. Aug 07 04:55:32.079170 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-59c5b058-26b8-4dc2-bd4e-ae15dfc3c8f9 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Returning 404 to user: Instance ebbb4a6b-6863-4efc-8e24-5073fcf14368 could not be found. {{(pid=107486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 07 04:55:32.080007 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-59c5b058-26b8-4dc2-bd4e-ae15dfc3c8f9 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] 10.222.0.35 "GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031387 Aug 07 04:55:32.080717 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 164/306] 10.222.0.35 () {58 vars in 1302 bytes} [Sat Aug 7 04:55:32 2021] GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 04:55:32.695586 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-2306ac7b-995b-4338-a270-eab4ee9edd83 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:32.696319 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-2306ac7b-995b-4338-a270-eab4ee9edd83 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:32.705957 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2306ac7b-995b-4338-a270-eab4ee9edd83 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:32.706411 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2306ac7b-995b-4338-a270-eab4ee9edd83 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:32.707200 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2306ac7b-995b-4338-a270-eab4ee9edd83 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:32.707638 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2306ac7b-995b-4338-a270-eab4ee9edd83 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:32.865521 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-2306ac7b-995b-4338-a270-eab4ee9edd83 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:32.866612 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-2306ac7b-995b-4338-a270-eab4ee9edd83 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1523 microversion: 2.1 time: 0.187579 Aug 07 04:55:32.867397 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 143/307] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:32 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1523 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:55:32.904486 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-abf7506f-0578-447f-92f6-9e20e4a91d4a tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:32.905167 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-abf7506f-0578-447f-92f6-9e20e4a91d4a tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] [instance: 9a4ce309-bcca-4504-9c88-5c183528a8f8] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:32.913499 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-abf7506f-0578-447f-92f6-9e20e4a91d4a tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:32.914016 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-abf7506f-0578-447f-92f6-9e20e4a91d4a tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:32.914843 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-abf7506f-0578-447f-92f6-9e20e4a91d4a tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:32.915275 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-abf7506f-0578-447f-92f6-9e20e4a91d4a tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:32.959534 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-c094f2ce-e9e5-4e5e-b946-4e3d164da89d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:55:32.960447 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-c094f2ce-e9e5-4e5e-b946-4e3d164da89d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:32.967285 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c094f2ce-e9e5-4e5e-b946-4e3d164da89d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:32.967735 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c094f2ce-e9e5-4e5e-b946-4e3d164da89d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:32.968514 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c094f2ce-e9e5-4e5e-b946-4e3d164da89d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:32.968981 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c094f2ce-e9e5-4e5e-b946-4e3d164da89d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:33.045981 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-abf7506f-0578-447f-92f6-9e20e4a91d4a tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a41fbfb1db4c2c8bb0c9ef8020a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910b734a3aa343fb9c79c6f1ae1ed425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:33.053613 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-abf7506f-0578-447f-92f6-9e20e4a91d4a tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] 10.222.0.35 "GET /compute/v2.1/servers/9a4ce309-bcca-4504-9c88-5c183528a8f8" status: 200 len: 1314 microversion: 2.1 time: 0.153937 Aug 07 04:55:33.054159 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 165/308] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:32 2021] GET /compute/v2.1/servers/9a4ce309-bcca-4504-9c88-5c183528a8f8 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:55:33.059012 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-49ea9f32-d14d-4364-b18c-eddd0ba4b8ab tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1511292020", "imageRef": "ddcf95b5-3ea4-4a61-8f54-4b2feadb8682", "flavorRef": "452", "networks": [{"uuid": "c0e4a04f-a799-47ad-9475-bb3ebbb61692"}]}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:55:33.124625 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.network.neutron [None req-49ea9f32-d14d-4364-b18c-eddd0ba4b8ab tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] validate_networks() for [('c0e4a04f-a799-47ad-9475-bb3ebbb61692', None, None, None)] {{(pid=107486) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 07 04:55:33.159851 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-c094f2ce-e9e5-4e5e-b946-4e3d164da89d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 28175 microversion: 2.20 time: 0.203606 Aug 07 04:55:33.169609 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 144/309] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:55:32 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 28175 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 07 04:55:33.441453 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-34908e88-bebb-4cb9-92b1-da1848ab7a34 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:33.442171 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-34908e88-bebb-4cb9-92b1-da1848ab7a34 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] [instance: ebbb4a6b-6863-4efc-8e24-5073fcf14368] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:33.449626 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-34908e88-bebb-4cb9-92b1-da1848ab7a34 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:33.450200 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-34908e88-bebb-4cb9-92b1-da1848ab7a34 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:33.451084 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-34908e88-bebb-4cb9-92b1-da1848ab7a34 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:33.451622 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-34908e88-bebb-4cb9-92b1-da1848ab7a34 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:33.466113 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.wsgi [None req-34908e88-bebb-4cb9-92b1-da1848ab7a34 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] HTTP exception thrown: Instance ebbb4a6b-6863-4efc-8e24-5073fcf14368 could not be found. Aug 07 04:55:33.466869 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-34908e88-bebb-4cb9-92b1-da1848ab7a34 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Returning 404 to user: Instance ebbb4a6b-6863-4efc-8e24-5073fcf14368 could not be found. {{(pid=107485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 07 04:55:33.467851 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-34908e88-bebb-4cb9-92b1-da1848ab7a34 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] 10.222.0.35 "DELETE /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368" status: 404 len: 111 microversion: 2.1 time: 0.030468 Aug 07 04:55:33.468496 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 145/310] 10.222.0.35 () {58 vars in 1239 bytes} [Sat Aug 7 04:55:33 2021] DELETE /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 04:55:33.476067 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-cb9146f5-12a7-4c63-8f4f-5a84d6d67c31 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:33.476961 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-cb9146f5-12a7-4c63-8f4f-5a84d6d67c31 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] [instance: ebbb4a6b-6863-4efc-8e24-5073fcf14368] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:33.490804 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-cb9146f5-12a7-4c63-8f4f-5a84d6d67c31 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:33.491376 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-cb9146f5-12a7-4c63-8f4f-5a84d6d67c31 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:33.492217 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-cb9146f5-12a7-4c63-8f4f-5a84d6d67c31 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:33.495222 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-cb9146f5-12a7-4c63-8f4f-5a84d6d67c31 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:33.511980 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.wsgi [None req-cb9146f5-12a7-4c63-8f4f-5a84d6d67c31 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] HTTP exception thrown: Instance ebbb4a6b-6863-4efc-8e24-5073fcf14368 could not be found. Aug 07 04:55:33.512566 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-cb9146f5-12a7-4c63-8f4f-5a84d6d67c31 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] Returning 404 to user: Instance ebbb4a6b-6863-4efc-8e24-5073fcf14368 could not be found. {{(pid=107485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 07 04:55:33.513410 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-cb9146f5-12a7-4c63-8f4f-5a84d6d67c31 tempest-DeleteServersTestJSON-1325601472 tempest-DeleteServersTestJSON-1325601472-project] 10.222.0.35 "GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368" status: 404 len: 111 microversion: 2.1 time: 0.040989 Aug 07 04:55:33.514452 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 146/311] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:33 2021] GET /compute/v2.1/servers/ebbb4a6b-6863-4efc-8e24-5073fcf14368 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 04:55:33.546326 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.virt.hardware [None req-49ea9f32-d14d-4364-b18c-eddd0ba4b8ab tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Flavor limits 0:0:0 {{(pid=107486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 04:55:33.547118 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.virt.hardware [None req-49ea9f32-d14d-4364-b18c-eddd0ba4b8ab tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Image limits 0:0:0 {{(pid=107486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 04:55:33.548042 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.virt.hardware [None req-49ea9f32-d14d-4364-b18c-eddd0ba4b8ab tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Flavor pref 0:0:0 {{(pid=107486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 04:55:33.548808 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.virt.hardware [None req-49ea9f32-d14d-4364-b18c-eddd0ba4b8ab tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Image pref 0:0:0 {{(pid=107486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 04:55:33.549576 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.virt.hardware [None req-49ea9f32-d14d-4364-b18c-eddd0ba4b8ab tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 04:55:33.564543 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-49ea9f32-d14d-4364-b18c-eddd0ba4b8ab tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:33.565357 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-49ea9f32-d14d-4364-b18c-eddd0ba4b8ab tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:33.567072 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-49ea9f32-d14d-4364-b18c-eddd0ba4b8ab tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:33.567752 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-49ea9f32-d14d-4364-b18c-eddd0ba4b8ab tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:33.598506 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.quota [None req-49ea9f32-d14d-4364-b18c-eddd0ba4b8ab tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Getting quotas for project 56d51e070d184693b32f62e300ded4fa. Resources: {'ram', 'cores', 'instances'} {{(pid=107486) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 07 04:55:33.607485 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.quota [None req-49ea9f32-d14d-4364-b18c-eddd0ba4b8ab tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Getting quotas for user d1a3194159fb47cdb59335fc442ad6dc and project 56d51e070d184693b32f62e300ded4fa. Resources: {'ram', 'cores', 'instances'} {{(pid=107486) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 07 04:55:33.618787 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-49ea9f32-d14d-4364-b18c-eddd0ba4b8ab tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Going to run 1 instances... {{(pid=107486) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 07 04:55:33.621710 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-49ea9f32-d14d-4364-b18c-eddd0ba4b8ab tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: c8b3c5de-8c8d-47a6-bee5-9422c9a66583] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ddcf95b5-3ea4-4a61-8f54-4b2feadb8682',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107486) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 07 04:55:33.672181 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-49ea9f32-d14d-4364-b18c-eddd0ba4b8ab tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.616988 Aug 07 04:55:33.673299 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 166/312] 10.222.0.35 () {60 vars in 1147 bytes} [Sat Aug 7 04:55:33 2021] POST /compute/v2.1/servers => generated 380 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 04:55:33.683696 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-f1b15807-139c-4ade-be75-250a4a830d6b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:33.684652 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-f1b15807-139c-4ade-be75-250a4a830d6b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: c8b3c5de-8c8d-47a6-bee5-9422c9a66583] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:33.756239 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-f1b15807-139c-4ade-be75-250a4a830d6b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:33.764533 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-f1b15807-139c-4ade-be75-250a4a830d6b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/c8b3c5de-8c8d-47a6-bee5-9422c9a66583" status: 200 len: 1218 microversion: 2.1 time: 0.085150 Aug 07 04:55:33.765429 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 147/313] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:33 2021] GET /compute/v2.1/servers/c8b3c5de-8c8d-47a6-bee5-9422c9a66583 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:55:33.892936 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-56474664-9aa2-4fd4-b007-722a810e96a5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:33.893554 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-56474664-9aa2-4fd4-b007-722a810e96a5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:33.905092 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-56474664-9aa2-4fd4-b007-722a810e96a5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:33.905736 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-56474664-9aa2-4fd4-b007-722a810e96a5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:33.906312 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-56474664-9aa2-4fd4-b007-722a810e96a5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:33.906891 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-56474664-9aa2-4fd4-b007-722a810e96a5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:34.082239 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-5ca7d8e2-124e-4e3b-b5b8-c1a4f50bbe86 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:34.083863 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-5ca7d8e2-124e-4e3b-b5b8-c1a4f50bbe86 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] [instance: 9a4ce309-bcca-4504-9c88-5c183528a8f8] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:34.092964 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5ca7d8e2-124e-4e3b-b5b8-c1a4f50bbe86 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:34.093798 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5ca7d8e2-124e-4e3b-b5b8-c1a4f50bbe86 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:34.094926 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5ca7d8e2-124e-4e3b-b5b8-c1a4f50bbe86 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:34.095542 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5ca7d8e2-124e-4e3b-b5b8-c1a4f50bbe86 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:34.163993 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-56474664-9aa2-4fd4-b007-722a810e96a5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:34.187573 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-56474664-9aa2-4fd4-b007-722a810e96a5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1523 microversion: 2.1 time: 0.305372 Aug 07 04:55:34.189667 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 167/314] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:33 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1523 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:55:34.202933 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-950a875f-1d78-4b9e-978c-8dc978d86563 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:55:34.204223 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-950a875f-1d78-4b9e-978c-8dc978d86563 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:34.211847 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-950a875f-1d78-4b9e-978c-8dc978d86563 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:34.212465 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-950a875f-1d78-4b9e-978c-8dc978d86563 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:34.213699 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-950a875f-1d78-4b9e-978c-8dc978d86563 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:34.214277 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-950a875f-1d78-4b9e-978c-8dc978d86563 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:34.427304 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-950a875f-1d78-4b9e-978c-8dc978d86563 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 28175 microversion: 2.20 time: 0.231935 Aug 07 04:55:34.428063 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 168/315] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:55:34 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 28175 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:55:34.585088 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-5ca7d8e2-124e-4e3b-b5b8-c1a4f50bbe86 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a41fbfb1db4c2c8bb0c9ef8020a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910b734a3aa343fb9c79c6f1ae1ed425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:34.593422 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-5ca7d8e2-124e-4e3b-b5b8-c1a4f50bbe86 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] 10.222.0.35 "GET /compute/v2.1/servers/9a4ce309-bcca-4504-9c88-5c183528a8f8" status: 200 len: 1314 microversion: 2.1 time: 0.516403 Aug 07 04:55:34.603338 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 148/316] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:34 2021] GET /compute/v2.1/servers/9a4ce309-bcca-4504-9c88-5c183528a8f8 => generated 1314 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:55:34.781959 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-89816124-ca89-4bd4-b596-0eedb824cf99 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:34.782979 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-89816124-ca89-4bd4-b596-0eedb824cf99 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: c8b3c5de-8c8d-47a6-bee5-9422c9a66583] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:34.792442 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-89816124-ca89-4bd4-b596-0eedb824cf99 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:34.792919 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-89816124-ca89-4bd4-b596-0eedb824cf99 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:34.795493 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-89816124-ca89-4bd4-b596-0eedb824cf99 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:34.795937 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-89816124-ca89-4bd4-b596-0eedb824cf99 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:34.886689 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-89816124-ca89-4bd4-b596-0eedb824cf99 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:34.897164 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-89816124-ca89-4bd4-b596-0eedb824cf99 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/c8b3c5de-8c8d-47a6-bee5-9422c9a66583" status: 200 len: 1270 microversion: 2.1 time: 0.118810 Aug 07 04:55:34.898181 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 169/317] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:34 2021] GET /compute/v2.1/servers/c8b3c5de-8c8d-47a6-bee5-9422c9a66583 => generated 1270 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:55:35.208080 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-9f534542-8824-4408-88f0-f383497fe727 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:35.208692 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-9f534542-8824-4408-88f0-f383497fe727 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:35.217826 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9f534542-8824-4408-88f0-f383497fe727 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:35.218625 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9f534542-8824-4408-88f0-f383497fe727 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:35.219675 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9f534542-8824-4408-88f0-f383497fe727 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:35.220467 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9f534542-8824-4408-88f0-f383497fe727 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:35.439219 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-a9679805-47de-4a89-9f04-66a84e608a94 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:55:35.440158 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-a9679805-47de-4a89-9f04-66a84e608a94 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:35.450173 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a9679805-47de-4a89-9f04-66a84e608a94 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:35.450936 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a9679805-47de-4a89-9f04-66a84e608a94 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:35.453109 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a9679805-47de-4a89-9f04-66a84e608a94 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:35.454152 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a9679805-47de-4a89-9f04-66a84e608a94 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:35.491966 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-9f534542-8824-4408-88f0-f383497fe727 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:35.514875 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-9f534542-8824-4408-88f0-f383497fe727 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1503 microversion: 2.1 time: 0.310596 Aug 07 04:55:35.527421 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 149/318] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:35 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1503 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:55:35.533328 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-45e21930-adb4-4233-96f9-d471603a9c60 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:35.534174 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-45e21930-adb4-4233-96f9-d471603a9c60 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:35.540478 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-45e21930-adb4-4233-96f9-d471603a9c60 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:35.552644 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-45e21930-adb4-4233-96f9-d471603a9c60 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:35.553751 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-45e21930-adb4-4233-96f9-d471603a9c60 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:35.554380 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-45e21930-adb4-4233-96f9-d471603a9c60 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:35.598937 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-a9679805-47de-4a89-9f04-66a84e608a94 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 28175 microversion: 2.20 time: 0.163093 Aug 07 04:55:35.603872 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 170/319] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:55:35 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 28175 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:55:35.614642 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-7b4ec978-1017-4963-89a9-fa5db4b44bb6 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:35.621452 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-7b4ec978-1017-4963-89a9-fa5db4b44bb6 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] [instance: 9a4ce309-bcca-4504-9c88-5c183528a8f8] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:35.634868 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-7b4ec978-1017-4963-89a9-fa5db4b44bb6 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:35.640931 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-7b4ec978-1017-4963-89a9-fa5db4b44bb6 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:35.641948 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-7b4ec978-1017-4963-89a9-fa5db4b44bb6 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:35.642533 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-7b4ec978-1017-4963-89a9-fa5db4b44bb6 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:35.870636 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-45e21930-adb4-4233-96f9-d471603a9c60 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:35.881230 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-45e21930-adb4-4233-96f9-d471603a9c60 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1516 microversion: 2.1 time: 0.351989 Aug 07 04:55:35.881950 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 150/320] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:35 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1516 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:55:35.924123 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-70b7cfa7-126e-47da-96ea-cb5c53afa20b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:35.925296 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-70b7cfa7-126e-47da-96ea-cb5c53afa20b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: c8b3c5de-8c8d-47a6-bee5-9422c9a66583] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:35.934831 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-7b4ec978-1017-4963-89a9-fa5db4b44bb6 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a41fbfb1db4c2c8bb0c9ef8020a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910b734a3aa343fb9c79c6f1ae1ed425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:35.942466 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-70b7cfa7-126e-47da-96ea-cb5c53afa20b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:35.944624 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-70b7cfa7-126e-47da-96ea-cb5c53afa20b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:35.945064 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-7b4ec978-1017-4963-89a9-fa5db4b44bb6 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] 10.222.0.35 "GET /compute/v2.1/servers/9a4ce309-bcca-4504-9c88-5c183528a8f8" status: 200 len: 1314 microversion: 2.1 time: 0.335335 Aug 07 04:55:35.954262 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 171/321] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:35 2021] GET /compute/v2.1/servers/9a4ce309-bcca-4504-9c88-5c183528a8f8 => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:55:35.954600 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-70b7cfa7-126e-47da-96ea-cb5c53afa20b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:35.954600 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-70b7cfa7-126e-47da-96ea-cb5c53afa20b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:36.103879 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-70b7cfa7-126e-47da-96ea-cb5c53afa20b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:36.111918 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-70b7cfa7-126e-47da-96ea-cb5c53afa20b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/c8b3c5de-8c8d-47a6-bee5-9422c9a66583" status: 200 len: 1276 microversion: 2.1 time: 0.201097 Aug 07 04:55:36.115982 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 151/322] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:35 2021] GET /compute/v2.1/servers/c8b3c5de-8c8d-47a6-bee5-9422c9a66583 => generated 1276 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:55:36.615643 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-cca332a8-ae5e-4473-9b4a-58ac3e0cd9e2 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:55:36.617702 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-cca332a8-ae5e-4473-9b4a-58ac3e0cd9e2 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:36.625593 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-cca332a8-ae5e-4473-9b4a-58ac3e0cd9e2 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:36.626497 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-cca332a8-ae5e-4473-9b4a-58ac3e0cd9e2 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:36.627611 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-cca332a8-ae5e-4473-9b4a-58ac3e0cd9e2 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:36.628244 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-cca332a8-ae5e-4473-9b4a-58ac3e0cd9e2 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:36.746709 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-cca332a8-ae5e-4473-9b4a-58ac3e0cd9e2 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 28175 microversion: 2.20 time: 0.138724 Aug 07 04:55:36.751259 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 172/323] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:55:36 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 28175 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:55:36.964285 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-49d2a5d5-fe78-4db5-baae-c1f01ffd784e tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:36.965375 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-49d2a5d5-fe78-4db5-baae-c1f01ffd784e tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] [instance: 9a4ce309-bcca-4504-9c88-5c183528a8f8] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:36.971824 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-49d2a5d5-fe78-4db5-baae-c1f01ffd784e tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:36.972267 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-49d2a5d5-fe78-4db5-baae-c1f01ffd784e tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:36.973063 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-49d2a5d5-fe78-4db5-baae-c1f01ffd784e tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:36.973490 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-49d2a5d5-fe78-4db5-baae-c1f01ffd784e tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:37.133530 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-1d267c89-a436-4ff0-96c5-d146a2b2e150 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:37.134551 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-1d267c89-a436-4ff0-96c5-d146a2b2e150 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: c8b3c5de-8c8d-47a6-bee5-9422c9a66583] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:37.145089 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1d267c89-a436-4ff0-96c5-d146a2b2e150 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:37.146842 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1d267c89-a436-4ff0-96c5-d146a2b2e150 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:37.148936 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1d267c89-a436-4ff0-96c5-d146a2b2e150 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:37.153314 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1d267c89-a436-4ff0-96c5-d146a2b2e150 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:37.340334 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-49d2a5d5-fe78-4db5-baae-c1f01ffd784e tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a41fbfb1db4c2c8bb0c9ef8020a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910b734a3aa343fb9c79c6f1ae1ed425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:37.360835 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-1d267c89-a436-4ff0-96c5-d146a2b2e150 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:37.373016 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-1d267c89-a436-4ff0-96c5-d146a2b2e150 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/c8b3c5de-8c8d-47a6-bee5-9422c9a66583" status: 200 len: 1318 microversion: 2.1 time: 0.244418 Aug 07 04:55:37.373842 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-49d2a5d5-fe78-4db5-baae-c1f01ffd784e tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] 10.222.0.35 "GET /compute/v2.1/servers/9a4ce309-bcca-4504-9c88-5c183528a8f8" status: 200 len: 1314 microversion: 2.1 time: 0.406275 Aug 07 04:55:37.376562 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 152/324] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:36 2021] GET /compute/v2.1/servers/9a4ce309-bcca-4504-9c88-5c183528a8f8 => generated 1314 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:55:37.377169 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 173/325] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:37 2021] GET /compute/v2.1/servers/c8b3c5de-8c8d-47a6-bee5-9422c9a66583 => generated 1318 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:55:37.679830 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [req-4dd59b97-b31a-467e-ac9d-0e34bcd0e194 req-6d6da954-5dc4-4f5c-a095-6437e88d6cce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8b3c5de-8c8d-47a6-bee5-9422c9a66583", "tag": "2d316e0b-8eea-4346-9431-4ce3f3d44c94"}]} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:55:37.683147 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 04:55:37.683147 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: warnings.warn(msg) Aug 07 04:55:37.699102 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-4dd59b97-b31a-467e-ac9d-0e34bcd0e194 req-6d6da954-5dc4-4f5c-a095-6437e88d6cce service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:37.702130 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-4dd59b97-b31a-467e-ac9d-0e34bcd0e194 req-6d6da954-5dc4-4f5c-a095-6437e88d6cce service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:37.719926 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.compute.server_external_events [req-4dd59b97-b31a-467e-ac9d-0e34bcd0e194 req-6d6da954-5dc4-4f5c-a095-6437e88d6cce service nova] Creating event network-changed:2d316e0b-8eea-4346-9431-4ce3f3d44c94 for instance c8b3c5de-8c8d-47a6-bee5-9422c9a66583 on hv-cinder-80374 Aug 07 04:55:37.725672 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [req-4dd59b97-b31a-467e-ac9d-0e34bcd0e194 req-6d6da954-5dc4-4f5c-a095-6437e88d6cce service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049251 Aug 07 04:55:37.731830 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 153/326] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 04:55:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:55:37.759349 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-b8bec470-ad14-43c4-a888-506fb07bae0f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:55:37.761425 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-b8bec470-ad14-43c4-a888-506fb07bae0f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:37.779287 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b8bec470-ad14-43c4-a888-506fb07bae0f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:37.781602 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b8bec470-ad14-43c4-a888-506fb07bae0f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:37.783352 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b8bec470-ad14-43c4-a888-506fb07bae0f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:37.785048 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b8bec470-ad14-43c4-a888-506fb07bae0f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:37.905044 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-b8bec470-ad14-43c4-a888-506fb07bae0f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 28175 microversion: 2.20 time: 0.149389 Aug 07 04:55:37.909617 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 174/327] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:55:37 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 28175 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:55:38.391708 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-3aa8215b-8c4a-47a3-9764-5e055e8c5feb tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:38.392404 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-3aa8215b-8c4a-47a3-9764-5e055e8c5feb tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] [instance: 9a4ce309-bcca-4504-9c88-5c183528a8f8] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:38.392764 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-ce19cf56-48e9-4036-a0a8-744552bf9778 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:38.393742 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-ce19cf56-48e9-4036-a0a8-744552bf9778 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: c8b3c5de-8c8d-47a6-bee5-9422c9a66583] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:38.399647 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3aa8215b-8c4a-47a3-9764-5e055e8c5feb tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:38.401142 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3aa8215b-8c4a-47a3-9764-5e055e8c5feb tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:38.401272 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ce19cf56-48e9-4036-a0a8-744552bf9778 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:38.402294 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3aa8215b-8c4a-47a3-9764-5e055e8c5feb tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:38.402946 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3aa8215b-8c4a-47a3-9764-5e055e8c5feb tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:38.409334 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ce19cf56-48e9-4036-a0a8-744552bf9778 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:38.412506 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ce19cf56-48e9-4036-a0a8-744552bf9778 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:38.413193 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ce19cf56-48e9-4036-a0a8-744552bf9778 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:38.613972 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-ce19cf56-48e9-4036-a0a8-744552bf9778 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:38.622730 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-ce19cf56-48e9-4036-a0a8-744552bf9778 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/c8b3c5de-8c8d-47a6-bee5-9422c9a66583" status: 200 len: 1318 microversion: 2.1 time: 0.234745 Aug 07 04:55:38.623519 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 175/328] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:38 2021] GET /compute/v2.1/servers/c8b3c5de-8c8d-47a6-bee5-9422c9a66583 => generated 1318 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:55:38.623848 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-3aa8215b-8c4a-47a3-9764-5e055e8c5feb tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a41fbfb1db4c2c8bb0c9ef8020a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910b734a3aa343fb9c79c6f1ae1ed425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:38.631669 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-3aa8215b-8c4a-47a3-9764-5e055e8c5feb tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] 10.222.0.35 "GET /compute/v2.1/servers/9a4ce309-bcca-4504-9c88-5c183528a8f8" status: 200 len: 1314 microversion: 2.1 time: 0.243899 Aug 07 04:55:38.632231 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 154/329] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:38 2021] GET /compute/v2.1/servers/9a4ce309-bcca-4504-9c88-5c183528a8f8 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:55:38.732720 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-c90aa5ba-be0b-4d41-9185-e97104039a8f tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:55:38.734355 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-c90aa5ba-be0b-4d41-9185-e97104039a8f tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:38.742429 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c90aa5ba-be0b-4d41-9185-e97104039a8f tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:38.743040 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c90aa5ba-be0b-4d41-9185-e97104039a8f tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:38.743954 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c90aa5ba-be0b-4d41-9185-e97104039a8f tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:38.744849 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c90aa5ba-be0b-4d41-9185-e97104039a8f tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:38.775016 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.objects.instance [None req-c90aa5ba-be0b-4d41-9185-e97104039a8f tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lazy-loading 'flavor' on Instance uuid 90d6eef5-1c82-472b-adfb-aeaa1e93d502 {{(pid=107486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 04:55:38.879989 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-c90aa5ba-be0b-4d41-9185-e97104039a8f tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "POST /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502/action" status: 200 len: 32 microversion: 2.1 time: 0.152140 Aug 07 04:55:38.882327 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 176/330] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 04:55:38 2021] POST /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502/action => generated 32 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 04:55:38.895613 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-2cd696c4-38c7-4ea4-9aa9-5a9d9ac998f8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:38.896206 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-2cd696c4-38c7-4ea4-9aa9-5a9d9ac998f8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:38.904383 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2cd696c4-38c7-4ea4-9aa9-5a9d9ac998f8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:38.904749 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2cd696c4-38c7-4ea4-9aa9-5a9d9ac998f8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:38.905550 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2cd696c4-38c7-4ea4-9aa9-5a9d9ac998f8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:38.905982 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2cd696c4-38c7-4ea4-9aa9-5a9d9ac998f8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:38.917838 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-ca4647d4-c09f-4e44-851f-6191bfedbacd tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:55:38.919466 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-ca4647d4-c09f-4e44-851f-6191bfedbacd tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:38.927594 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ca4647d4-c09f-4e44-851f-6191bfedbacd tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:38.928371 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ca4647d4-c09f-4e44-851f-6191bfedbacd tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:38.929422 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ca4647d4-c09f-4e44-851f-6191bfedbacd tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:38.930072 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ca4647d4-c09f-4e44-851f-6191bfedbacd tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:39.050475 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-ca4647d4-c09f-4e44-851f-6191bfedbacd tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 28175 microversion: 2.20 time: 0.137224 Aug 07 04:55:39.055455 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 177/331] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:55:38 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 28175 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:55:39.063867 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [req-7b1cbb3b-69db-40a7-933e-6c6851daba5e req-36026503-f17e-4eaf-97af-76c5f032f90f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a4ce309-bcca-4504-9c88-5c183528a8f8", "name": "network-vif-plugged", "status": "completed", "tag": "337a0ff1-4895-4bdd-89c0-fa8596538184"}]} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:55:39.066493 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 04:55:39.066493 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: warnings.warn(msg) Aug 07 04:55:39.076116 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-7b1cbb3b-69db-40a7-933e-6c6851daba5e req-36026503-f17e-4eaf-97af-76c5f032f90f service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:39.076886 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-7b1cbb3b-69db-40a7-933e-6c6851daba5e req-36026503-f17e-4eaf-97af-76c5f032f90f service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:39.091884 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.compute.server_external_events [req-7b1cbb3b-69db-40a7-933e-6c6851daba5e req-36026503-f17e-4eaf-97af-76c5f032f90f service nova] Creating event network-vif-plugged:337a0ff1-4895-4bdd-89c0-fa8596538184 for instance 9a4ce309-bcca-4504-9c88-5c183528a8f8 on hv-cinder-80374 Aug 07 04:55:39.097526 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [req-7b1cbb3b-69db-40a7-933e-6c6851daba5e req-36026503-f17e-4eaf-97af-76c5f032f90f service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039934 Aug 07 04:55:39.098518 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 178/332] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 04:55:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:55:39.153390 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-2cd696c4-38c7-4ea4-9aa9-5a9d9ac998f8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:39.162801 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-2cd696c4-38c7-4ea4-9aa9-5a9d9ac998f8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1522 microversion: 2.1 time: 0.275777 Aug 07 04:55:39.163925 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 155/333] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:38 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1522 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:55:39.336981 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-18e71c12-8e10-4015-a318-b96ca54f5d5e tempest-VolumesTestJSON-1659368500 tempest-VolumesTestJSON-1659368500-project] Calling method '.version_select at 0x7f75f88d9700>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:39.407105 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-18e71c12-8e10-4015-a318-b96ca54f5d5e tempest-VolumesTestJSON-1659368500 tempest-VolumesTestJSON-1659368500-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/f3ceb063-34de-4b23-84d5-0620560298ec" status: 200 len: 351 microversion: 2.1 time: 0.074864 Aug 07 04:55:39.407808 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 179/334] 10.222.0.35 () {58 vars in 1245 bytes} [Sat Aug 7 04:55:39 2021] GET /compute/v2.1/os-volumes/f3ceb063-34de-4b23-84d5-0620560298ec => generated 351 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:55:39.648611 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-0e79aaf3-6332-42c4-bbab-fb1166556a1b tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:39.649330 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-d2875a12-72fb-4a9b-b11e-89a722d4aaf9 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:39.649804 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-0e79aaf3-6332-42c4-bbab-fb1166556a1b tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] [instance: 9a4ce309-bcca-4504-9c88-5c183528a8f8] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:39.649885 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-d2875a12-72fb-4a9b-b11e-89a722d4aaf9 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: c8b3c5de-8c8d-47a6-bee5-9422c9a66583] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:39.657078 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0e79aaf3-6332-42c4-bbab-fb1166556a1b tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:39.657599 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0e79aaf3-6332-42c4-bbab-fb1166556a1b tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:39.658450 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0e79aaf3-6332-42c4-bbab-fb1166556a1b tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:39.658879 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0e79aaf3-6332-42c4-bbab-fb1166556a1b tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:39.663055 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d2875a12-72fb-4a9b-b11e-89a722d4aaf9 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:39.668606 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d2875a12-72fb-4a9b-b11e-89a722d4aaf9 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:39.670104 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d2875a12-72fb-4a9b-b11e-89a722d4aaf9 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:39.670104 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d2875a12-72fb-4a9b-b11e-89a722d4aaf9 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:39.840783 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-0e79aaf3-6332-42c4-bbab-fb1166556a1b tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a41fbfb1db4c2c8bb0c9ef8020a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910b734a3aa343fb9c79c6f1ae1ed425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:39.849663 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-0e79aaf3-6332-42c4-bbab-fb1166556a1b tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] 10.222.0.35 "GET /compute/v2.1/servers/9a4ce309-bcca-4504-9c88-5c183528a8f8" status: 200 len: 1314 microversion: 2.1 time: 0.204980 Aug 07 04:55:39.850227 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 180/335] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:39 2021] GET /compute/v2.1/servers/9a4ce309-bcca-4504-9c88-5c183528a8f8 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:55:39.912943 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-d2875a12-72fb-4a9b-b11e-89a722d4aaf9 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:39.920676 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-d2875a12-72fb-4a9b-b11e-89a722d4aaf9 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/c8b3c5de-8c8d-47a6-bee5-9422c9a66583" status: 200 len: 1318 microversion: 2.1 time: 0.277166 Aug 07 04:55:39.921215 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 156/336] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:39 2021] GET /compute/v2.1/servers/c8b3c5de-8c8d-47a6-bee5-9422c9a66583 => generated 1318 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:55:40.062623 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-15a7dade-6865-45dc-a14b-a9f20656ddd5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:55:40.063595 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-15a7dade-6865-45dc-a14b-a9f20656ddd5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:40.069626 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-15a7dade-6865-45dc-a14b-a9f20656ddd5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:40.070081 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-15a7dade-6865-45dc-a14b-a9f20656ddd5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:40.070892 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-15a7dade-6865-45dc-a14b-a9f20656ddd5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:40.071351 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-15a7dade-6865-45dc-a14b-a9f20656ddd5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:40.190144 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-15a7dade-6865-45dc-a14b-a9f20656ddd5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 28175 microversion: 2.20 time: 0.130899 Aug 07 04:55:40.190350 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-c89cacf2-abf9-443d-9acd-e4d439869300 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:40.190711 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 181/337] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:55:40 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 28175 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:55:40.194279 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-c89cacf2-abf9-443d-9acd-e4d439869300 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:40.201124 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c89cacf2-abf9-443d-9acd-e4d439869300 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:40.201791 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c89cacf2-abf9-443d-9acd-e4d439869300 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:40.202584 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c89cacf2-abf9-443d-9acd-e4d439869300 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:40.203019 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c89cacf2-abf9-443d-9acd-e4d439869300 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:40.356100 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-c89cacf2-abf9-443d-9acd-e4d439869300 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:40.363979 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-c89cacf2-abf9-443d-9acd-e4d439869300 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1522 microversion: 2.1 time: 0.186887 Aug 07 04:55:40.364891 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 157/338] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:40 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:55:40.775661 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-0c0e1328-6fa5-4109-b5e7-98a231a05bd1 tempest-VolumesTestJSON-1659368500 tempest-VolumesTestJSON-1659368500-project] Calling method '.version_select at 0x7f75f892f4c0>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:40.829081 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-0c0e1328-6fa5-4109-b5e7-98a231a05bd1 tempest-VolumesTestJSON-1659368500 tempest-VolumesTestJSON-1659368500-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/3838d4c4-e2a3-4614-b20c-0dab1dbbe1f1" status: 200 len: 351 microversion: 2.1 time: 0.058967 Aug 07 04:55:40.829644 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 182/339] 10.222.0.35 () {58 vars in 1245 bytes} [Sat Aug 7 04:55:40 2021] GET /compute/v2.1/os-volumes/3838d4c4-e2a3-4614-b20c-0dab1dbbe1f1 => generated 351 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:55:40.867036 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-17b842fa-c6c4-4b40-8b90-1c74e7a2658c tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:40.867717 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-17b842fa-c6c4-4b40-8b90-1c74e7a2658c tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] [instance: 9a4ce309-bcca-4504-9c88-5c183528a8f8] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:40.873641 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-17b842fa-c6c4-4b40-8b90-1c74e7a2658c tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:40.874188 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-17b842fa-c6c4-4b40-8b90-1c74e7a2658c tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:40.875007 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-17b842fa-c6c4-4b40-8b90-1c74e7a2658c tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:40.875501 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-17b842fa-c6c4-4b40-8b90-1c74e7a2658c tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:40.937375 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-9054eaee-9550-497b-bfdb-bda1d6fb5663 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:40.938744 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-9054eaee-9550-497b-bfdb-bda1d6fb5663 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: c8b3c5de-8c8d-47a6-bee5-9422c9a66583] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:40.948750 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9054eaee-9550-497b-bfdb-bda1d6fb5663 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:40.949144 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9054eaee-9550-497b-bfdb-bda1d6fb5663 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:40.949938 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9054eaee-9550-497b-bfdb-bda1d6fb5663 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:40.950385 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9054eaee-9550-497b-bfdb-bda1d6fb5663 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:41.014622 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-17b842fa-c6c4-4b40-8b90-1c74e7a2658c tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a41fbfb1db4c2c8bb0c9ef8020a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910b734a3aa343fb9c79c6f1ae1ed425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:41.022322 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-17b842fa-c6c4-4b40-8b90-1c74e7a2658c tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] 10.222.0.35 "GET /compute/v2.1/servers/9a4ce309-bcca-4504-9c88-5c183528a8f8" status: 200 len: 1314 microversion: 2.1 time: 0.158975 Aug 07 04:55:41.023052 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 158/340] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:40 2021] GET /compute/v2.1/servers/9a4ce309-bcca-4504-9c88-5c183528a8f8 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:55:41.102232 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-9054eaee-9550-497b-bfdb-bda1d6fb5663 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:41.113194 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-9054eaee-9550-497b-bfdb-bda1d6fb5663 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/c8b3c5de-8c8d-47a6-bee5-9422c9a66583" status: 200 len: 1318 microversion: 2.1 time: 0.179355 Aug 07 04:55:41.113728 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 183/341] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:40 2021] GET /compute/v2.1/servers/c8b3c5de-8c8d-47a6-bee5-9422c9a66583 => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:55:41.202590 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-c5349b58-2b14-48cc-ae94-01b99d48104e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:55:41.203589 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-c5349b58-2b14-48cc-ae94-01b99d48104e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:41.210104 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c5349b58-2b14-48cc-ae94-01b99d48104e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:41.210484 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c5349b58-2b14-48cc-ae94-01b99d48104e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:41.211306 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c5349b58-2b14-48cc-ae94-01b99d48104e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:41.211734 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c5349b58-2b14-48cc-ae94-01b99d48104e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:41.366946 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-c5349b58-2b14-48cc-ae94-01b99d48104e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 28175 microversion: 2.20 time: 0.167967 Aug 07 04:55:41.367589 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 159/342] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:55:41 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 28175 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:55:41.380773 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-300ffe2a-8290-4dbd-ba9f-438bcc59351d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:41.381431 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-300ffe2a-8290-4dbd-ba9f-438bcc59351d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:41.387904 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-300ffe2a-8290-4dbd-ba9f-438bcc59351d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:41.388346 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-300ffe2a-8290-4dbd-ba9f-438bcc59351d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:41.389139 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-300ffe2a-8290-4dbd-ba9f-438bcc59351d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:41.389572 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-300ffe2a-8290-4dbd-ba9f-438bcc59351d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:41.509360 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-300ffe2a-8290-4dbd-ba9f-438bcc59351d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:41.517015 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-300ffe2a-8290-4dbd-ba9f-438bcc59351d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1522 microversion: 2.1 time: 0.139848 Aug 07 04:55:41.517781 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 184/343] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:41 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1522 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:55:42.039551 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-134daecc-2a44-4ced-962d-56c1dfda162d tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:42.040248 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-134daecc-2a44-4ced-962d-56c1dfda162d tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] [instance: 9a4ce309-bcca-4504-9c88-5c183528a8f8] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:42.047883 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-134daecc-2a44-4ced-962d-56c1dfda162d tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:42.048265 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-134daecc-2a44-4ced-962d-56c1dfda162d tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:42.049060 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-134daecc-2a44-4ced-962d-56c1dfda162d tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:42.049493 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-134daecc-2a44-4ced-962d-56c1dfda162d tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:42.130963 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-388efc72-5d61-4874-8df5-9a9418e34500 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:42.131678 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-388efc72-5d61-4874-8df5-9a9418e34500 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: c8b3c5de-8c8d-47a6-bee5-9422c9a66583] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:42.141341 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-388efc72-5d61-4874-8df5-9a9418e34500 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:42.141805 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-388efc72-5d61-4874-8df5-9a9418e34500 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:42.142762 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-388efc72-5d61-4874-8df5-9a9418e34500 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:42.143696 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-388efc72-5d61-4874-8df5-9a9418e34500 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:42.171737 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-134daecc-2a44-4ced-962d-56c1dfda162d tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a41fbfb1db4c2c8bb0c9ef8020a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910b734a3aa343fb9c79c6f1ae1ed425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:42.178750 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-134daecc-2a44-4ced-962d-56c1dfda162d tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] 10.222.0.35 "GET /compute/v2.1/servers/9a4ce309-bcca-4504-9c88-5c183528a8f8" status: 200 len: 1498 microversion: 2.1 time: 0.143134 Aug 07 04:55:42.179303 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 160/344] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:42 2021] GET /compute/v2.1/servers/9a4ce309-bcca-4504-9c88-5c183528a8f8 => generated 1498 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:55:42.267398 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-388efc72-5d61-4874-8df5-9a9418e34500 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:42.274527 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-388efc72-5d61-4874-8df5-9a9418e34500 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/c8b3c5de-8c8d-47a6-bee5-9422c9a66583" status: 200 len: 1318 microversion: 2.1 time: 0.147521 Aug 07 04:55:42.275276 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 185/345] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:42 2021] GET /compute/v2.1/servers/c8b3c5de-8c8d-47a6-bee5-9422c9a66583 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:55:42.379015 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-dd545a1f-9684-462c-a9bf-7d2996af18ff tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:55:42.379957 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-dd545a1f-9684-462c-a9bf-7d2996af18ff tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:42.385829 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-dd545a1f-9684-462c-a9bf-7d2996af18ff tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:42.386273 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-dd545a1f-9684-462c-a9bf-7d2996af18ff tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:42.387039 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-dd545a1f-9684-462c-a9bf-7d2996af18ff tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:42.387467 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-dd545a1f-9684-462c-a9bf-7d2996af18ff tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:42.501202 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-dd545a1f-9684-462c-a9bf-7d2996af18ff tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 28175 microversion: 2.20 time: 0.125666 Aug 07 04:55:42.501873 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 161/346] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:55:42 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 28175 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:55:42.533770 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-851277a2-08b7-498c-98bd-daaa6c70cb53 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:42.534376 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-851277a2-08b7-498c-98bd-daaa6c70cb53 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:42.540233 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-851277a2-08b7-498c-98bd-daaa6c70cb53 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:42.541279 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-851277a2-08b7-498c-98bd-daaa6c70cb53 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:42.542083 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-851277a2-08b7-498c-98bd-daaa6c70cb53 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:42.542574 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-851277a2-08b7-498c-98bd-daaa6c70cb53 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:42.673783 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-851277a2-08b7-498c-98bd-daaa6c70cb53 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:42.682361 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-851277a2-08b7-498c-98bd-daaa6c70cb53 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1522 microversion: 2.1 time: 0.152195 Aug 07 04:55:42.683487 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 186/347] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:42 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:55:43.145194 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-2642d47a-ab1b-4bad-8f32-1b43c622a7f1 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:43.145888 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-2642d47a-ab1b-4bad-8f32-1b43c622a7f1 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] [instance: 9a4ce309-bcca-4504-9c88-5c183528a8f8] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:43.153059 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2642d47a-ab1b-4bad-8f32-1b43c622a7f1 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:43.153500 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2642d47a-ab1b-4bad-8f32-1b43c622a7f1 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:43.154271 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2642d47a-ab1b-4bad-8f32-1b43c622a7f1 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:43.154695 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2642d47a-ab1b-4bad-8f32-1b43c622a7f1 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:43.183499 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-2642d47a-ab1b-4bad-8f32-1b43c622a7f1 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] [instance: 9a4ce309-bcca-4504-9c88-5c183528a8f8] Going to try to terminate instance {{(pid=107485) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 07 04:55:43.234526 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-c2223b28-a5ff-416e-ba53-82c77d922472 tempest-VolumesTestJSON-1659368500 tempest-VolumesTestJSON-1659368500-project] Calling method '.version_select at 0x7f75f898a820>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:43.282335 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-2642d47a-ab1b-4bad-8f32-1b43c622a7f1 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] 10.222.0.35 "DELETE /compute/v2.1/servers/9a4ce309-bcca-4504-9c88-5c183528a8f8" status: 204 len: 0 microversion: 2.1 time: 0.141331 Aug 07 04:55:43.282933 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 162/348] 10.222.0.35 () {58 vars in 1239 bytes} [Sat Aug 7 04:55:43 2021] DELETE /compute/v2.1/servers/9a4ce309-bcca-4504-9c88-5c183528a8f8 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 04:55:43.292751 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-1d59fa29-459c-4adb-8f36-1661c92dc70e tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:43.293107 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-c2223b28-a5ff-416e-ba53-82c77d922472 tempest-VolumesTestJSON-1659368500 tempest-VolumesTestJSON-1659368500-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/0945a9a4-fcf5-47c8-b0af-9b1a8548bfd6" status: 200 len: 351 microversion: 2.1 time: 0.062509 Aug 07 04:55:43.293498 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-1d59fa29-459c-4adb-8f36-1661c92dc70e tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] [instance: 9a4ce309-bcca-4504-9c88-5c183528a8f8] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:43.293675 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 187/349] 10.222.0.35 () {58 vars in 1245 bytes} [Sat Aug 7 04:55:43 2021] GET /compute/v2.1/os-volumes/0945a9a4-fcf5-47c8-b0af-9b1a8548bfd6 => generated 351 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:55:43.298409 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-ddcb354b-b22a-4ce2-ae9a-451bf2adcbda tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:43.299118 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-ddcb354b-b22a-4ce2-ae9a-451bf2adcbda tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: c8b3c5de-8c8d-47a6-bee5-9422c9a66583] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:43.299229 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1d59fa29-459c-4adb-8f36-1661c92dc70e tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:43.299684 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1d59fa29-459c-4adb-8f36-1661c92dc70e tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:43.300703 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1d59fa29-459c-4adb-8f36-1661c92dc70e tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:43.300879 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1d59fa29-459c-4adb-8f36-1661c92dc70e tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:43.305520 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ddcb354b-b22a-4ce2-ae9a-451bf2adcbda tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:43.306803 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ddcb354b-b22a-4ce2-ae9a-451bf2adcbda tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:43.307608 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ddcb354b-b22a-4ce2-ae9a-451bf2adcbda tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:43.308073 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ddcb354b-b22a-4ce2-ae9a-451bf2adcbda tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:43.434096 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-1d59fa29-459c-4adb-8f36-1661c92dc70e tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a41fbfb1db4c2c8bb0c9ef8020a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910b734a3aa343fb9c79c6f1ae1ed425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:43.434968 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-ddcb354b-b22a-4ce2-ae9a-451bf2adcbda tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:43.442317 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-ddcb354b-b22a-4ce2-ae9a-451bf2adcbda tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/c8b3c5de-8c8d-47a6-bee5-9422c9a66583" status: 200 len: 1318 microversion: 2.1 time: 0.147686 Aug 07 04:55:43.442486 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-1d59fa29-459c-4adb-8f36-1661c92dc70e tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] 10.222.0.35 "GET /compute/v2.1/servers/9a4ce309-bcca-4504-9c88-5c183528a8f8" status: 200 len: 1504 microversion: 2.1 time: 0.154971 Aug 07 04:55:43.442903 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 188/350] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:43 2021] GET /compute/v2.1/servers/c8b3c5de-8c8d-47a6-bee5-9422c9a66583 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:55:43.443426 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 163/351] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:43 2021] GET /compute/v2.1/servers/9a4ce309-bcca-4504-9c88-5c183528a8f8 => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:55:43.452389 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-e5254e26-da5f-474a-865f-bd46d0abae7f tempest-VolumesTestJSON-1659368500 tempest-VolumesTestJSON-1659368500-project] Calling method '.version_select at 0x7f75f89c19d0>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:43.513259 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-01c75d25-0aed-455a-b07d-adbb72eabafa tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:55:43.514305 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-01c75d25-0aed-455a-b07d-adbb72eabafa tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:43.520270 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-01c75d25-0aed-455a-b07d-adbb72eabafa tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:43.520689 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-01c75d25-0aed-455a-b07d-adbb72eabafa tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:43.521690 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-01c75d25-0aed-455a-b07d-adbb72eabafa tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:43.522075 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-01c75d25-0aed-455a-b07d-adbb72eabafa tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:43.532563 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-e5254e26-da5f-474a-865f-bd46d0abae7f tempest-VolumesTestJSON-1659368500 tempest-VolumesTestJSON-1659368500-project] 10.222.0.35 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.086228 Aug 07 04:55:43.533385 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 189/352] 10.222.0.35 () {58 vars in 1134 bytes} [Sat Aug 7 04:55:43 2021] GET /compute/v2.1/os-volumes => generated 1036 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:55:43.546481 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-4b8084ff-ea24-4056-8f23-d30821e41acb tempest-VolumesTestJSON-1659368500 tempest-VolumesTestJSON-1659368500-project] Calling method '.version_select at 0x7f75f892f550>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:43.625515 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-01c75d25-0aed-455a-b07d-adbb72eabafa tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 28175 microversion: 2.20 time: 0.116001 Aug 07 04:55:43.626822 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 164/353] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:55:43 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 28175 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 07 04:55:43.632465 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-4b8084ff-ea24-4056-8f23-d30821e41acb tempest-VolumesTestJSON-1659368500 tempest-VolumesTestJSON-1659368500-project] 10.222.0.35 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.089719 Aug 07 04:55:43.640452 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 190/354] 10.222.0.35 () {58 vars in 1149 bytes} [Sat Aug 7 04:55:43 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 04:55:43.646026 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-eac39ddd-c854-4964-8359-e90b05c0dde3 tempest-VolumesTestJSON-1659368500 tempest-VolumesTestJSON-1659368500-project] Calling method '.version_select at 0x7f75f8177700>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:43.699688 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-4d25d419-685f-485b-9c0f-16b6ccb73886 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:43.700304 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-4d25d419-685f-485b-9c0f-16b6ccb73886 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:43.707121 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4d25d419-685f-485b-9c0f-16b6ccb73886 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:43.707565 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4d25d419-685f-485b-9c0f-16b6ccb73886 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:43.708337 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4d25d419-685f-485b-9c0f-16b6ccb73886 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:43.708766 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4d25d419-685f-485b-9c0f-16b6ccb73886 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:43.731588 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-eac39ddd-c854-4964-8359-e90b05c0dde3 tempest-VolumesTestJSON-1659368500 tempest-VolumesTestJSON-1659368500-project] 10.222.0.35 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.089470 Aug 07 04:55:43.732294 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 165/355] 10.222.0.35 () {58 vars in 1134 bytes} [Sat Aug 7 04:55:43 2021] GET /compute/v2.1/os-volumes => generated 1036 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:55:43.742473 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-b319a483-5689-4df6-a20f-715036433568 tempest-VolumesTestJSON-1659368500 tempest-VolumesTestJSON-1659368500-project] Calling method '.version_select at 0x7f75f81944c0>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:43.824466 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-b319a483-5689-4df6-a20f-715036433568 tempest-VolumesTestJSON-1659368500 tempest-VolumesTestJSON-1659368500-project] 10.222.0.35 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.085247 Aug 07 04:55:43.825304 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 166/356] 10.222.0.35 () {58 vars in 1167 bytes} [Sat Aug 7 04:55:43 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 04:55:43.836044 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-48b5bd68-dda8-460b-b7ef-6584b905b0e3 tempest-VolumesTestJSON-1659368500 tempest-VolumesTestJSON-1659368500-project] Calling method '.version_select at 0x7f75f8194d30>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:43.838841 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-4d25d419-685f-485b-9c0f-16b6ccb73886 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:43.846666 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-4d25d419-685f-485b-9c0f-16b6ccb73886 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1522 microversion: 2.1 time: 0.151149 Aug 07 04:55:43.847317 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 191/357] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:43 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:55:43.916447 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-48b5bd68-dda8-460b-b7ef-6584b905b0e3 tempest-VolumesTestJSON-1659368500 tempest-VolumesTestJSON-1659368500-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.083249 Aug 07 04:55:43.917031 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 167/358] 10.222.0.35 () {58 vars in 1170 bytes} [Sat Aug 7 04:55:43 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 04:55:43.928906 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-13c4e354-b225-4ae3-b360-9de916ba5142 tempest-VolumesTestJSON-1659368500 tempest-VolumesTestJSON-1659368500-project] Calling method '.version_select at 0x7f75f89a4700>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:44.009642 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-13c4e354-b225-4ae3-b360-9de916ba5142 tempest-VolumesTestJSON-1659368500 tempest-VolumesTestJSON-1659368500-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.084264 Aug 07 04:55:44.010159 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 192/359] 10.222.0.35 () {58 vars in 1155 bytes} [Sat Aug 7 04:55:43 2021] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:55:44.020990 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-3d859725-9b7d-43e5-ae55-b58676d4789d tempest-VolumesTestJSON-1659368500 tempest-VolumesTestJSON-1659368500-project] Calling method '.version_select at 0x7f75f81d5b80>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:44.106742 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-3d859725-9b7d-43e5-ae55-b58676d4789d tempest-VolumesTestJSON-1659368500 tempest-VolumesTestJSON-1659368500-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.089192 Aug 07 04:55:44.107302 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 168/360] 10.222.0.35 () {58 vars in 1188 bytes} [Sat Aug 7 04:55:44 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:55:44.118685 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-158fc071-2eac-403f-a389-48005099cd2f tempest-VolumesTestJSON-1659368500 tempest-VolumesTestJSON-1659368500-project] Calling method '.version_select at 0x7f75f88d9a60>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:44.211297 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-158fc071-2eac-403f-a389-48005099cd2f tempest-VolumesTestJSON-1659368500 tempest-VolumesTestJSON-1659368500-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.096262 Aug 07 04:55:44.211865 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 193/361] 10.222.0.35 () {58 vars in 1155 bytes} [Sat Aug 7 04:55:44 2021] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:55:44.460377 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-c76b48aa-1a0f-473e-93bb-daf4be5d8769 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:44.460852 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-b20f3276-e522-4cba-9356-dd34c363deff tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:44.461240 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-c76b48aa-1a0f-473e-93bb-daf4be5d8769 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: c8b3c5de-8c8d-47a6-bee5-9422c9a66583] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:44.461332 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-b20f3276-e522-4cba-9356-dd34c363deff tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] [instance: 9a4ce309-bcca-4504-9c88-5c183528a8f8] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:44.468103 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c76b48aa-1a0f-473e-93bb-daf4be5d8769 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:44.468755 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c76b48aa-1a0f-473e-93bb-daf4be5d8769 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:44.469592 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b20f3276-e522-4cba-9356-dd34c363deff tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:44.469934 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c76b48aa-1a0f-473e-93bb-daf4be5d8769 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:44.470063 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b20f3276-e522-4cba-9356-dd34c363deff tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:44.470367 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c76b48aa-1a0f-473e-93bb-daf4be5d8769 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:44.470810 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b20f3276-e522-4cba-9356-dd34c363deff tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:44.471247 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b20f3276-e522-4cba-9356-dd34c363deff tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:44.635126 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-c76b48aa-1a0f-473e-93bb-daf4be5d8769 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:44.645107 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-c76b48aa-1a0f-473e-93bb-daf4be5d8769 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/c8b3c5de-8c8d-47a6-bee5-9422c9a66583" status: 200 len: 1318 microversion: 2.1 time: 0.188218 Aug 07 04:55:44.645753 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 169/362] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:44 2021] GET /compute/v2.1/servers/c8b3c5de-8c8d-47a6-bee5-9422c9a66583 => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:55:44.646342 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-b20f3276-e522-4cba-9356-dd34c363deff tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a41fbfb1db4c2c8bb0c9ef8020a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910b734a3aa343fb9c79c6f1ae1ed425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:44.659637 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-b20f3276-e522-4cba-9356-dd34c363deff tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] 10.222.0.35 "GET /compute/v2.1/servers/9a4ce309-bcca-4504-9c88-5c183528a8f8" status: 200 len: 1504 microversion: 2.1 time: 0.202025 Aug 07 04:55:44.660918 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-843c29b5-49a3-41d0-988f-71b5a18ad523 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:55:44.662126 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-843c29b5-49a3-41d0-988f-71b5a18ad523 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:44.664938 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 194/363] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:44 2021] GET /compute/v2.1/servers/9a4ce309-bcca-4504-9c88-5c183528a8f8 => generated 1504 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:55:44.669689 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-843c29b5-49a3-41d0-988f-71b5a18ad523 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:44.670074 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-843c29b5-49a3-41d0-988f-71b5a18ad523 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:44.670837 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-843c29b5-49a3-41d0-988f-71b5a18ad523 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:44.671265 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-843c29b5-49a3-41d0-988f-71b5a18ad523 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:44.850187 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-843c29b5-49a3-41d0-988f-71b5a18ad523 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 28175 microversion: 2.20 time: 0.203142 Aug 07 04:55:44.854207 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 170/364] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:55:44 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 28175 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:55:44.864329 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-8371e2e9-b43c-41a9-8906-56278ede3747 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:44.865077 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-8371e2e9-b43c-41a9-8906-56278ede3747 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:44.871962 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8371e2e9-b43c-41a9-8906-56278ede3747 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:44.872405 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8371e2e9-b43c-41a9-8906-56278ede3747 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:44.873281 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8371e2e9-b43c-41a9-8906-56278ede3747 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:44.873714 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8371e2e9-b43c-41a9-8906-56278ede3747 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:45.044031 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-8371e2e9-b43c-41a9-8906-56278ede3747 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:45.051418 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-8371e2e9-b43c-41a9-8906-56278ede3747 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1522 microversion: 2.1 time: 0.190907 Aug 07 04:55:45.052035 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 195/365] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:44 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:55:45.662530 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-27f19a06-1844-4650-a703-2deb85b080ca tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:45.663735 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-27f19a06-1844-4650-a703-2deb85b080ca tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: c8b3c5de-8c8d-47a6-bee5-9422c9a66583] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:45.671262 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-27f19a06-1844-4650-a703-2deb85b080ca tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:45.671927 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-27f19a06-1844-4650-a703-2deb85b080ca tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:45.677543 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-fd525c79-bd0d-4732-b5b8-d1fd6c7bade6 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:45.678635 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-fd525c79-bd0d-4732-b5b8-d1fd6c7bade6 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] [instance: 9a4ce309-bcca-4504-9c88-5c183528a8f8] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:45.684487 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-27f19a06-1844-4650-a703-2deb85b080ca tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:45.684947 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-27f19a06-1844-4650-a703-2deb85b080ca tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:45.689278 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-fd525c79-bd0d-4732-b5b8-d1fd6c7bade6 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:45.689901 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-fd525c79-bd0d-4732-b5b8-d1fd6c7bade6 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:45.691024 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-fd525c79-bd0d-4732-b5b8-d1fd6c7bade6 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:45.691602 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-fd525c79-bd0d-4732-b5b8-d1fd6c7bade6 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:45.887128 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-27f19a06-1844-4650-a703-2deb85b080ca tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:45.896820 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-27f19a06-1844-4650-a703-2deb85b080ca tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/c8b3c5de-8c8d-47a6-bee5-9422c9a66583" status: 200 len: 1318 microversion: 2.1 time: 0.238083 Aug 07 04:55:45.897485 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 171/366] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:45 2021] GET /compute/v2.1/servers/c8b3c5de-8c8d-47a6-bee5-9422c9a66583 => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:55:45.902493 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-a3a5f40e-6e1a-4e72-b4eb-84446f040f31 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:55:45.903696 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-a3a5f40e-6e1a-4e72-b4eb-84446f040f31 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:45.910001 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a3a5f40e-6e1a-4e72-b4eb-84446f040f31 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:45.910451 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a3a5f40e-6e1a-4e72-b4eb-84446f040f31 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:45.911239 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a3a5f40e-6e1a-4e72-b4eb-84446f040f31 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:45.911678 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a3a5f40e-6e1a-4e72-b4eb-84446f040f31 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:46.032661 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-a3a5f40e-6e1a-4e72-b4eb-84446f040f31 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 28466 microversion: 2.20 time: 0.133623 Aug 07 04:55:46.033398 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 172/367] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:55:45 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 28466 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:55:46.068925 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-3f9aa342-ce96-42f3-bb75-1d046aa68068 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:46.069728 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-3f9aa342-ce96-42f3-bb75-1d046aa68068 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:46.077208 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3f9aa342-ce96-42f3-bb75-1d046aa68068 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:46.077733 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3f9aa342-ce96-42f3-bb75-1d046aa68068 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:46.078928 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3f9aa342-ce96-42f3-bb75-1d046aa68068 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:46.079428 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3f9aa342-ce96-42f3-bb75-1d046aa68068 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:46.142452 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-fd525c79-bd0d-4732-b5b8-d1fd6c7bade6 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a41fbfb1db4c2c8bb0c9ef8020a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910b734a3aa343fb9c79c6f1ae1ed425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:46.153428 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-fd525c79-bd0d-4732-b5b8-d1fd6c7bade6 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] 10.222.0.35 "GET /compute/v2.1/servers/9a4ce309-bcca-4504-9c88-5c183528a8f8" status: 200 len: 1504 microversion: 2.1 time: 0.479731 Aug 07 04:55:46.163374 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 196/368] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:45 2021] GET /compute/v2.1/servers/9a4ce309-bcca-4504-9c88-5c183528a8f8 => generated 1504 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:55:46.260389 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-3f9aa342-ce96-42f3-bb75-1d046aa68068 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:46.268862 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-3f9aa342-ce96-42f3-bb75-1d046aa68068 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1522 microversion: 2.1 time: 0.203840 Aug 07 04:55:46.269695 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 173/369] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:46 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:55:46.339009 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [req-8c3b59c5-5a6d-4ccb-9026-b4f469b1f74e req-3acc956c-e125-4797-bae8-36ef52b06534 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a4ce309-bcca-4504-9c88-5c183528a8f8", "name": "network-vif-deleted", "tag": "337a0ff1-4895-4bdd-89c0-fa8596538184"}]} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:55:46.343892 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 04:55:46.343892 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: warnings.warn(msg) Aug 07 04:55:46.351147 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-8c3b59c5-5a6d-4ccb-9026-b4f469b1f74e req-3acc956c-e125-4797-bae8-36ef52b06534 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:46.351683 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-8c3b59c5-5a6d-4ccb-9026-b4f469b1f74e req-3acc956c-e125-4797-bae8-36ef52b06534 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:46.363622 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.compute.server_external_events [req-8c3b59c5-5a6d-4ccb-9026-b4f469b1f74e req-3acc956c-e125-4797-bae8-36ef52b06534 service nova] Creating event network-vif-deleted:337a0ff1-4895-4bdd-89c0-fa8596538184 for instance 9a4ce309-bcca-4504-9c88-5c183528a8f8 on hv-cinder-80374 Aug 07 04:55:46.369159 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [req-8c3b59c5-5a6d-4ccb-9026-b4f469b1f74e req-3acc956c-e125-4797-bae8-36ef52b06534 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036224 Aug 07 04:55:46.369979 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 197/370] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 04:55:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:55:46.916108 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-69258fab-c78f-4ac0-a353-b3b91c0feaf1 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:46.918182 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-69258fab-c78f-4ac0-a353-b3b91c0feaf1 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: c8b3c5de-8c8d-47a6-bee5-9422c9a66583] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:46.932820 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-69258fab-c78f-4ac0-a353-b3b91c0feaf1 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:46.933786 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-69258fab-c78f-4ac0-a353-b3b91c0feaf1 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:46.936313 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-69258fab-c78f-4ac0-a353-b3b91c0feaf1 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:46.936953 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-69258fab-c78f-4ac0-a353-b3b91c0feaf1 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:46.967727 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [req-77c47cab-acc2-4e2c-973f-5bbd7843ae41 req-dbea5512-30e7-46ba-bb0a-d54c69e86e26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8b3c5de-8c8d-47a6-bee5-9422c9a66583", "name": "network-vif-plugged", "status": "completed", "tag": "2d316e0b-8eea-4346-9431-4ce3f3d44c94"}]} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:55:46.970021 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 04:55:46.970021 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: warnings.warn(msg) Aug 07 04:55:46.985840 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-77c47cab-acc2-4e2c-973f-5bbd7843ae41 req-dbea5512-30e7-46ba-bb0a-d54c69e86e26 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:46.986617 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-77c47cab-acc2-4e2c-973f-5bbd7843ae41 req-dbea5512-30e7-46ba-bb0a-d54c69e86e26 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:47.002442 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.compute.server_external_events [req-77c47cab-acc2-4e2c-973f-5bbd7843ae41 req-dbea5512-30e7-46ba-bb0a-d54c69e86e26 service nova] Creating event network-vif-plugged:2d316e0b-8eea-4346-9431-4ce3f3d44c94 for instance c8b3c5de-8c8d-47a6-bee5-9422c9a66583 on hv-cinder-80374 Aug 07 04:55:47.017712 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [req-77c47cab-acc2-4e2c-973f-5bbd7843ae41 req-dbea5512-30e7-46ba-bb0a-d54c69e86e26 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063685 Aug 07 04:55:47.018582 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 198/371] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 04:55:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:55:47.045881 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-5d9c4baa-9032-4e3e-804e-a6728dcc13ab tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:55:47.046962 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-5d9c4baa-9032-4e3e-804e-a6728dcc13ab tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:47.053738 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5d9c4baa-9032-4e3e-804e-a6728dcc13ab tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:47.054473 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5d9c4baa-9032-4e3e-804e-a6728dcc13ab tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:47.055443 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5d9c4baa-9032-4e3e-804e-a6728dcc13ab tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:47.056063 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5d9c4baa-9032-4e3e-804e-a6728dcc13ab tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:47.132074 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-69258fab-c78f-4ac0-a353-b3b91c0feaf1 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:47.140046 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-69258fab-c78f-4ac0-a353-b3b91c0feaf1 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/c8b3c5de-8c8d-47a6-bee5-9422c9a66583" status: 200 len: 1318 microversion: 2.1 time: 0.229659 Aug 07 04:55:47.141251 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 174/372] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:46 2021] GET /compute/v2.1/servers/c8b3c5de-8c8d-47a6-bee5-9422c9a66583 => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:55:47.186111 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-dca879a6-e969-433b-9e11-53f6964b7581 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:47.187647 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-dca879a6-e969-433b-9e11-53f6964b7581 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] [instance: 9a4ce309-bcca-4504-9c88-5c183528a8f8] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:47.188258 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-5d9c4baa-9032-4e3e-804e-a6728dcc13ab tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 28466 microversion: 2.20 time: 0.145068 Aug 07 04:55:47.189034 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 199/373] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:55:47 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 28466 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 07 04:55:47.199499 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-dca879a6-e969-433b-9e11-53f6964b7581 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:47.202126 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-dca879a6-e969-433b-9e11-53f6964b7581 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:47.202569 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-dca879a6-e969-433b-9e11-53f6964b7581 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:47.204878 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-dca879a6-e969-433b-9e11-53f6964b7581 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:47.221424 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.wsgi [None req-dca879a6-e969-433b-9e11-53f6964b7581 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] HTTP exception thrown: Instance 9a4ce309-bcca-4504-9c88-5c183528a8f8 could not be found. Aug 07 04:55:47.222033 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-dca879a6-e969-433b-9e11-53f6964b7581 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Returning 404 to user: Instance 9a4ce309-bcca-4504-9c88-5c183528a8f8 could not be found. {{(pid=107485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 07 04:55:47.223060 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-dca879a6-e969-433b-9e11-53f6964b7581 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] 10.222.0.35 "GET /compute/v2.1/servers/9a4ce309-bcca-4504-9c88-5c183528a8f8" status: 404 len: 111 microversion: 2.1 time: 0.052481 Aug 07 04:55:47.223774 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 175/374] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:47 2021] GET /compute/v2.1/servers/9a4ce309-bcca-4504-9c88-5c183528a8f8 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 04:55:47.287497 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-aa160e3e-5d01-45cc-bcd5-8346d731d204 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:47.288666 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-aa160e3e-5d01-45cc-bcd5-8346d731d204 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:47.298084 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-aa160e3e-5d01-45cc-bcd5-8346d731d204 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:47.298626 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-aa160e3e-5d01-45cc-bcd5-8346d731d204 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:47.299561 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-aa160e3e-5d01-45cc-bcd5-8346d731d204 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:47.300495 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-aa160e3e-5d01-45cc-bcd5-8346d731d204 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:47.374022 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-0576659c-3d97-43b8-9994-e64ade62ca47 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-446981982", "imageRef": "ddcf95b5-3ea4-4a61-8f54-4b2feadb8682", "flavorRef": "452", "networks": [{"uuid": "a75033fe-395c-44bd-aeca-8b2f84f00266"}]}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:55:47.446974 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-aa160e3e-5d01-45cc-bcd5-8346d731d204 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:47.454935 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-aa160e3e-5d01-45cc-bcd5-8346d731d204 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1522 microversion: 2.1 time: 0.172076 Aug 07 04:55:47.455482 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 200/375] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:47 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:55:48.157283 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-ff138cae-45c9-4b45-a520-6a1d6439269e tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:48.157962 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-ff138cae-45c9-4b45-a520-6a1d6439269e tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: c8b3c5de-8c8d-47a6-bee5-9422c9a66583] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:48.164225 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ff138cae-45c9-4b45-a520-6a1d6439269e tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:48.164701 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ff138cae-45c9-4b45-a520-6a1d6439269e tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:48.165504 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ff138cae-45c9-4b45-a520-6a1d6439269e tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:48.165937 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ff138cae-45c9-4b45-a520-6a1d6439269e tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:48.313297 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-ff138cae-45c9-4b45-a520-6a1d6439269e tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:48.321605 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-ff138cae-45c9-4b45-a520-6a1d6439269e tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/c8b3c5de-8c8d-47a6-bee5-9422c9a66583" status: 200 len: 1318 microversion: 2.1 time: 0.167925 Aug 07 04:55:48.322180 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 201/376] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:48 2021] GET /compute/v2.1/servers/c8b3c5de-8c8d-47a6-bee5-9422c9a66583 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:55:48.328385 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-3767abb6-fe40-4a7f-b4d6-a3ec66f54b55 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:55:48.329557 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-3767abb6-fe40-4a7f-b4d6-a3ec66f54b55 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:48.335477 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3767abb6-fe40-4a7f-b4d6-a3ec66f54b55 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:48.335990 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3767abb6-fe40-4a7f-b4d6-a3ec66f54b55 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:48.336915 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3767abb6-fe40-4a7f-b4d6-a3ec66f54b55 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:48.337345 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3767abb6-fe40-4a7f-b4d6-a3ec66f54b55 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:48.470948 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-3767abb6-fe40-4a7f-b4d6-a3ec66f54b55 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 28634 microversion: 2.20 time: 0.146112 Aug 07 04:55:48.471751 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 202/377] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:55:48 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 28634 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:55:48.476721 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-810cf42f-9ea6-4487-9913-2e4695450bfc tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:48.477440 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-810cf42f-9ea6-4487-9913-2e4695450bfc tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:48.484450 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-810cf42f-9ea6-4487-9913-2e4695450bfc tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:48.484946 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-810cf42f-9ea6-4487-9913-2e4695450bfc tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:48.485694 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-810cf42f-9ea6-4487-9913-2e4695450bfc tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:48.486132 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-810cf42f-9ea6-4487-9913-2e4695450bfc tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:48.658848 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-810cf42f-9ea6-4487-9913-2e4695450bfc tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:48.666960 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-810cf42f-9ea6-4487-9913-2e4695450bfc tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1522 microversion: 2.1 time: 0.193379 Aug 07 04:55:48.667534 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 203/378] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:48 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:55:49.338266 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-ae685682-16fa-4f27-a405-cd4b5503acf3 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:49.338969 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-ae685682-16fa-4f27-a405-cd4b5503acf3 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: c8b3c5de-8c8d-47a6-bee5-9422c9a66583] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:49.345162 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ae685682-16fa-4f27-a405-cd4b5503acf3 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:49.345613 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ae685682-16fa-4f27-a405-cd4b5503acf3 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:49.346388 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ae685682-16fa-4f27-a405-cd4b5503acf3 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:49.346822 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ae685682-16fa-4f27-a405-cd4b5503acf3 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:49.495143 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-ae685682-16fa-4f27-a405-cd4b5503acf3 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:49.502389 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-ae685682-16fa-4f27-a405-cd4b5503acf3 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/c8b3c5de-8c8d-47a6-bee5-9422c9a66583" status: 200 len: 1506 microversion: 2.1 time: 0.167857 Aug 07 04:55:49.502945 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 204/379] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:49 2021] GET /compute/v2.1/servers/c8b3c5de-8c8d-47a6-bee5-9422c9a66583 => generated 1506 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:55:49.507222 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-07e09361-520a-4f04-9231-2b2ed83b1c20 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:55:49.508100 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-07e09361-520a-4f04-9231-2b2ed83b1c20 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:49.516564 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-07e09361-520a-4f04-9231-2b2ed83b1c20 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:49.517153 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-07e09361-520a-4f04-9231-2b2ed83b1c20 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:49.518046 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-07e09361-520a-4f04-9231-2b2ed83b1c20 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:49.518507 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-07e09361-520a-4f04-9231-2b2ed83b1c20 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:49.625800 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-07e09361-520a-4f04-9231-2b2ed83b1c20 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 28634 microversion: 2.20 time: 0.119586 Aug 07 04:55:49.628052 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 205/380] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:55:49 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 28634 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:55:49.639620 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-3772f70c-0a4c-4475-a12a-e340134364d2 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "48e560e1-894f-4988-9022-d9410f707c18"}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:55:49.640872 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-3772f70c-0a4c-4475-a12a-e340134364d2 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: c8b3c5de-8c8d-47a6-bee5-9422c9a66583] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:49.647493 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3772f70c-0a4c-4475-a12a-e340134364d2 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:49.647857 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3772f70c-0a4c-4475-a12a-e340134364d2 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:49.648717 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3772f70c-0a4c-4475-a12a-e340134364d2 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:49.649273 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3772f70c-0a4c-4475-a12a-e340134364d2 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:49.800661 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.wsgi [None req-3772f70c-0a4c-4475-a12a-e340134364d2 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] HTTP exception thrown: Invalid volume: volume 48e560e1-894f-4988-9022-d9410f707c18 is already attached to instances: 3bba229d-781a-409e-8079-6c9764d8124b Aug 07 04:55:49.802347 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-3772f70c-0a4c-4475-a12a-e340134364d2 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Returning 400 to user: Invalid volume: volume 48e560e1-894f-4988-9022-d9410f707c18 is already attached to instances: 3bba229d-781a-409e-8079-6c9764d8124b {{(pid=107486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 07 04:55:49.803285 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-3772f70c-0a4c-4475-a12a-e340134364d2 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "POST /compute/v2.1/servers/c8b3c5de-8c8d-47a6-bee5-9422c9a66583/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.174174 Aug 07 04:55:49.803914 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 206/381] 10.222.0.35 () {60 vars in 1323 bytes} [Sat Aug 7 04:55:49 2021] POST /compute/v2.1/servers/c8b3c5de-8c8d-47a6-bee5-9422c9a66583/os-volume_attachments => generated 174 bytes in 175 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 04:55:49.809481 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-e4415981-3a2b-4bba-a82c-6cd52d205ce7 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:49.810214 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-e4415981-3a2b-4bba-a82c-6cd52d205ce7 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:49.817295 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e4415981-3a2b-4bba-a82c-6cd52d205ce7 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:49.817911 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e4415981-3a2b-4bba-a82c-6cd52d205ce7 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:49.818886 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e4415981-3a2b-4bba-a82c-6cd52d205ce7 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:49.819323 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e4415981-3a2b-4bba-a82c-6cd52d205ce7 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:49.983709 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-e4415981-3a2b-4bba-a82c-6cd52d205ce7 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:49.991063 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-e4415981-3a2b-4bba-a82c-6cd52d205ce7 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1522 microversion: 2.1 time: 0.186014 Aug 07 04:55:49.991829 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 207/382] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:49 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:55:49.996169 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-8e3e055f-a1c4-4781-9c71-d83bcd52c39e tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:49.996863 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-8e3e055f-a1c4-4781-9c71-d83bcd52c39e tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:50.002632 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8e3e055f-a1c4-4781-9c71-d83bcd52c39e tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:50.003080 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8e3e055f-a1c4-4781-9c71-d83bcd52c39e tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:50.003849 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8e3e055f-a1c4-4781-9c71-d83bcd52c39e tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:50.004281 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8e3e055f-a1c4-4781-9c71-d83bcd52c39e tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:50.133771 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.objects.instance [None req-8e3e055f-a1c4-4781-9c71-d83bcd52c39e tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lazy-loading 'services' on Instance uuid 3bba229d-781a-409e-8079-6c9764d8124b {{(pid=107486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 04:55:50.242791 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-8e3e055f-a1c4-4781-9c71-d83bcd52c39e tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "DELETE /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b/os-volume_attachments/48e560e1-894f-4988-9022-d9410f707c18" status: 202 len: 0 microversion: 2.1 time: 0.249980 Aug 07 04:55:50.243441 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 208/383] 10.222.0.35 () {58 vars in 1416 bytes} [Sat Aug 7 04:55:49 2021] DELETE /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b/os-volume_attachments/48e560e1-894f-4988-9022-d9410f707c18 => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:55:50.252428 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-5d3c8df5-f4e3-43ec-a990-d98e981611d5 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:50.258296 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-5d3c8df5-f4e3-43ec-a990-d98e981611d5 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:50.266340 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5d3c8df5-f4e3-43ec-a990-d98e981611d5 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:50.267139 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5d3c8df5-f4e3-43ec-a990-d98e981611d5 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:50.268188 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5d3c8df5-f4e3-43ec-a990-d98e981611d5 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:50.268874 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5d3c8df5-f4e3-43ec-a990-d98e981611d5 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:50.308748 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-5d3c8df5-f4e3-43ec-a990-d98e981611d5 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060323 Aug 07 04:55:50.309740 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 209/384] 10.222.0.35 () {58 vars in 1302 bytes} [Sat Aug 7 04:55:50 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:55:50.636281 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-21064e03-0adc-4044-b355-ef7ac0fa2d45 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:55:50.637382 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-21064e03-0adc-4044-b355-ef7ac0fa2d45 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:50.649570 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-21064e03-0adc-4044-b355-ef7ac0fa2d45 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:50.650014 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-21064e03-0adc-4044-b355-ef7ac0fa2d45 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:50.651196 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-21064e03-0adc-4044-b355-ef7ac0fa2d45 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:50.651619 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-21064e03-0adc-4044-b355-ef7ac0fa2d45 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:50.773016 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-21064e03-0adc-4044-b355-ef7ac0fa2d45 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 28634 microversion: 2.20 time: 0.140993 Aug 07 04:55:50.773718 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 210/385] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:55:50 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 28634 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 07 04:55:51.009503 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-333f8e64-feda-437d-9c72-0f28a9ce8e68 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:51.010854 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-333f8e64-feda-437d-9c72-0f28a9ce8e68 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:51.018276 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-333f8e64-feda-437d-9c72-0f28a9ce8e68 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:51.018896 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-333f8e64-feda-437d-9c72-0f28a9ce8e68 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:51.019908 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-333f8e64-feda-437d-9c72-0f28a9ce8e68 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:51.020597 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-333f8e64-feda-437d-9c72-0f28a9ce8e68 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:51.344330 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-333f8e64-feda-437d-9c72-0f28a9ce8e68 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:51.352127 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-333f8e64-feda-437d-9c72-0f28a9ce8e68 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1522 microversion: 2.1 time: 0.347015 Aug 07 04:55:51.352670 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 211/386] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:51 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1522 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:55:51.360358 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-5fe77b73-b881-481d-9a44-2e09c31a0287 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:51.361630 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-5fe77b73-b881-481d-9a44-2e09c31a0287 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:51.368074 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5fe77b73-b881-481d-9a44-2e09c31a0287 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:51.368760 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5fe77b73-b881-481d-9a44-2e09c31a0287 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:51.370860 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5fe77b73-b881-481d-9a44-2e09c31a0287 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:51.371562 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5fe77b73-b881-481d-9a44-2e09c31a0287 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:51.405183 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-5fe77b73-b881-481d-9a44-2e09c31a0287 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050728 Aug 07 04:55:51.405750 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 212/387] 10.222.0.35 () {58 vars in 1302 bytes} [Sat Aug 7 04:55:51 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:55:51.791987 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-dccee7cd-c23a-42c6-b53f-75be4747e0e5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:55:51.795238 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-dccee7cd-c23a-42c6-b53f-75be4747e0e5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:51.801772 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-dccee7cd-c23a-42c6-b53f-75be4747e0e5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:51.802270 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-dccee7cd-c23a-42c6-b53f-75be4747e0e5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:51.803082 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-dccee7cd-c23a-42c6-b53f-75be4747e0e5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:51.803788 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-dccee7cd-c23a-42c6-b53f-75be4747e0e5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:51.903631 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-dccee7cd-c23a-42c6-b53f-75be4747e0e5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 28634 microversion: 2.20 time: 0.121478 Aug 07 04:55:51.904397 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 213/388] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:55:51 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 28634 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 07 04:55:52.370126 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-e2eca622-ddef-4f14-9ae1-47acd5ed39be tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:52.370943 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-e2eca622-ddef-4f14-9ae1-47acd5ed39be tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:52.378627 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e2eca622-ddef-4f14-9ae1-47acd5ed39be tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:52.379486 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e2eca622-ddef-4f14-9ae1-47acd5ed39be tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:52.381764 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e2eca622-ddef-4f14-9ae1-47acd5ed39be tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:52.382358 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e2eca622-ddef-4f14-9ae1-47acd5ed39be tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:52.523083 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-e2eca622-ddef-4f14-9ae1-47acd5ed39be tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:55:52.533706 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-e2eca622-ddef-4f14-9ae1-47acd5ed39be tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1522 microversion: 2.1 time: 0.167728 Aug 07 04:55:52.534392 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 214/389] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:55:52 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:55:52.539404 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-d1a934f8-6422-4cbb-8342-acaae379c975 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:55:52.540375 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-d1a934f8-6422-4cbb-8342-acaae379c975 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:55:52.547198 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d1a934f8-6422-4cbb-8342-acaae379c975 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:52.547724 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d1a934f8-6422-4cbb-8342-acaae379c975 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:52.548650 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d1a934f8-6422-4cbb-8342-acaae379c975 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:55:52.549108 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d1a934f8-6422-4cbb-8342-acaae379c975 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:55:52.583794 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-d1a934f8-6422-4cbb-8342-acaae379c975 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048175 Aug 07 04:55:52.584721 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 215/390] 10.222.0.35 () {58 vars in 1302 bytes} [Sat Aug 7 04:55:52 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 04:55:52.784611 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-3971f9df-0d63-40ca-ad1d-86735d6d3323 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1543415049", "imageRef": "ddcf95b5-3ea4-4a61-8f54-4b2feadb8682", "flavorRef": "452", "networks": [{"uuid": "c0e4a04f-a799-47ad-9475-bb3ebbb61692"}]}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:56:02.168655 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.network.neutron [None req-0576659c-3d97-43b8-9994-e64ade62ca47 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] validate_networks() for [('a75033fe-395c-44bd-aeca-8b2f84f00266', None, None, None)] {{(pid=107485) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 07 04:56:02.184178 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.network.neutron [None req-3971f9df-0d63-40ca-ad1d-86735d6d3323 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] validate_networks() for [('c0e4a04f-a799-47ad-9475-bb3ebbb61692', None, None, None)] {{(pid=107486) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 07 04:56:02.644090 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.virt.hardware [None req-0576659c-3d97-43b8-9994-e64ade62ca47 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Flavor limits 0:0:0 {{(pid=107485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 04:56:02.644539 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.virt.hardware [None req-0576659c-3d97-43b8-9994-e64ade62ca47 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Image limits 0:0:0 {{(pid=107485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 04:56:02.647454 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.virt.hardware [None req-0576659c-3d97-43b8-9994-e64ade62ca47 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Flavor pref 0:0:0 {{(pid=107485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 04:56:02.649144 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.virt.hardware [None req-0576659c-3d97-43b8-9994-e64ade62ca47 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Image pref 0:0:0 {{(pid=107485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 04:56:02.649785 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.virt.hardware [None req-0576659c-3d97-43b8-9994-e64ade62ca47 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 04:56:02.695755 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0576659c-3d97-43b8-9994-e64ade62ca47 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:02.696216 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0576659c-3d97-43b8-9994-e64ade62ca47 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:02.702422 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0576659c-3d97-43b8-9994-e64ade62ca47 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:02.703010 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0576659c-3d97-43b8-9994-e64ade62ca47 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:02.762245 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.quota [None req-0576659c-3d97-43b8-9994-e64ade62ca47 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Getting quotas for project 910b734a3aa343fb9c79c6f1ae1ed425. Resources: {'ram', 'cores', 'instances'} {{(pid=107485) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 07 04:56:02.768236 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.quota [None req-0576659c-3d97-43b8-9994-e64ade62ca47 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Getting quotas for user e9a41fbfb1db4c2c8bb0c9ef8020a4b3 and project 910b734a3aa343fb9c79c6f1ae1ed425. Resources: {'ram', 'cores', 'instances'} {{(pid=107485) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 07 04:56:02.785716 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-0576659c-3d97-43b8-9994-e64ade62ca47 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Going to run 1 instances... {{(pid=107485) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 07 04:56:02.788955 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-0576659c-3d97-43b8-9994-e64ade62ca47 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] [instance: 17932a8a-0c0c-4510-85ad-98dbf1a77bdc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ddcf95b5-3ea4-4a61-8f54-4b2feadb8682',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107485) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 07 04:56:02.862835 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-0576659c-3d97-43b8-9994-e64ade62ca47 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 15.492467 Aug 07 04:56:02.864321 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 176/391] 10.222.0.35 () {60 vars in 1147 bytes} [Sat Aug 7 04:55:47 2021] POST /compute/v2.1/servers => generated 380 bytes in 15495 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 04:56:02.872407 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-8e033bdd-6180-4ea9-b19e-9d95b1947eed tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:56:02.873785 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-8e033bdd-6180-4ea9-b19e-9d95b1947eed tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:02.889667 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8e033bdd-6180-4ea9-b19e-9d95b1947eed tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:02.890122 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8e033bdd-6180-4ea9-b19e-9d95b1947eed tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:02.891122 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8e033bdd-6180-4ea9-b19e-9d95b1947eed tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:02.891766 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8e033bdd-6180-4ea9-b19e-9d95b1947eed tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:03.120766 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-8e033bdd-6180-4ea9-b19e-9d95b1947eed tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 28634 microversion: 2.20 time: 0.254938 Aug 07 04:56:03.121432 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 177/392] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:56:02 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 28634 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:56:03.128128 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-94b159fe-7fea-4876-8dba-1be8827ccb6d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:03.130175 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-94b159fe-7fea-4876-8dba-1be8827ccb6d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:03.147064 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-94b159fe-7fea-4876-8dba-1be8827ccb6d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:03.161260 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-94b159fe-7fea-4876-8dba-1be8827ccb6d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:03.163028 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-94b159fe-7fea-4876-8dba-1be8827ccb6d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:03.165006 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-94b159fe-7fea-4876-8dba-1be8827ccb6d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:03.252929 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.virt.hardware [None req-3971f9df-0d63-40ca-ad1d-86735d6d3323 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Flavor limits 0:0:0 {{(pid=107486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 04:56:03.253725 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.virt.hardware [None req-3971f9df-0d63-40ca-ad1d-86735d6d3323 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Image limits 0:0:0 {{(pid=107486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 04:56:03.254556 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.virt.hardware [None req-3971f9df-0d63-40ca-ad1d-86735d6d3323 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Flavor pref 0:0:0 {{(pid=107486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 04:56:03.255199 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.virt.hardware [None req-3971f9df-0d63-40ca-ad1d-86735d6d3323 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Image pref 0:0:0 {{(pid=107486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 04:56:03.255922 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.virt.hardware [None req-3971f9df-0d63-40ca-ad1d-86735d6d3323 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 04:56:03.279854 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3971f9df-0d63-40ca-ad1d-86735d6d3323 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:03.280611 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3971f9df-0d63-40ca-ad1d-86735d6d3323 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:03.281719 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3971f9df-0d63-40ca-ad1d-86735d6d3323 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:03.282479 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3971f9df-0d63-40ca-ad1d-86735d6d3323 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:03.315003 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.quota [None req-3971f9df-0d63-40ca-ad1d-86735d6d3323 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Getting quotas for project 56d51e070d184693b32f62e300ded4fa. Resources: {'ram', 'cores', 'instances'} {{(pid=107486) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 07 04:56:03.320949 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.quota [None req-3971f9df-0d63-40ca-ad1d-86735d6d3323 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Getting quotas for user d1a3194159fb47cdb59335fc442ad6dc and project 56d51e070d184693b32f62e300ded4fa. Resources: {'ram', 'cores', 'instances'} {{(pid=107486) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 07 04:56:03.336365 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-3971f9df-0d63-40ca-ad1d-86735d6d3323 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Going to run 1 instances... {{(pid=107486) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 07 04:56:03.340470 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-3971f9df-0d63-40ca-ad1d-86735d6d3323 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ddcf95b5-3ea4-4a61-8f54-4b2feadb8682',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107486) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 07 04:56:03.447178 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-3971f9df-0d63-40ca-ad1d-86735d6d3323 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 10.666099 Aug 07 04:56:03.448116 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 216/393] 10.222.0.35 () {60 vars in 1147 bytes} [Sat Aug 7 04:55:52 2021] POST /compute/v2.1/servers => generated 380 bytes in 10668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 04:56:03.456937 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-588445e8-3fa6-4589-bbdb-29f5a44c66a8 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:03.457344 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-588445e8-3fa6-4589-bbdb-29f5a44c66a8 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] [instance: 17932a8a-0c0c-4510-85ad-98dbf1a77bdc] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:03.531661 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-588445e8-3fa6-4589-bbdb-29f5a44c66a8 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a41fbfb1db4c2c8bb0c9ef8020a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910b734a3aa343fb9c79c6f1ae1ed425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:03.541595 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-588445e8-3fa6-4589-bbdb-29f5a44c66a8 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] 10.222.0.35 "GET /compute/v2.1/servers/17932a8a-0c0c-4510-85ad-98dbf1a77bdc" status: 200 len: 1213 microversion: 2.1 time: 0.091415 Aug 07 04:56:03.542649 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 217/394] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:03 2021] GET /compute/v2.1/servers/17932a8a-0c0c-4510-85ad-98dbf1a77bdc => generated 1213 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:56:03.549331 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-cfcd41b9-ed5d-490b-acfe-ef0eb66d6fad tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:03.550349 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-cfcd41b9-ed5d-490b-acfe-ef0eb66d6fad tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:03.607898 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-cfcd41b9-ed5d-490b-acfe-ef0eb66d6fad tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:03.615060 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-cfcd41b9-ed5d-490b-acfe-ef0eb66d6fad tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5" status: 200 len: 1218 microversion: 2.1 time: 0.071192 Aug 07 04:56:03.615630 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 218/395] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:03 2021] GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5 => generated 1218 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:56:03.820940 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-94b159fe-7fea-4876-8dba-1be8827ccb6d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:03.829032 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-94b159fe-7fea-4876-8dba-1be8827ccb6d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1522 microversion: 2.1 time: 0.706380 Aug 07 04:56:03.830127 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 178/396] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:03 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1522 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:56:04.132717 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-8512bf20-f9e3-462d-aeb0-215ece4b1078 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:56:04.133863 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-8512bf20-f9e3-462d-aeb0-215ece4b1078 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:04.140503 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8512bf20-f9e3-462d-aeb0-215ece4b1078 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:04.141063 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8512bf20-f9e3-462d-aeb0-215ece4b1078 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:04.141906 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8512bf20-f9e3-462d-aeb0-215ece4b1078 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:04.142405 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8512bf20-f9e3-462d-aeb0-215ece4b1078 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:04.559229 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-19b72b08-c800-49d9-9c3b-ab5569d4e8e1 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:04.560686 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-19b72b08-c800-49d9-9c3b-ab5569d4e8e1 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] [instance: 17932a8a-0c0c-4510-85ad-98dbf1a77bdc] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:04.568945 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-19b72b08-c800-49d9-9c3b-ab5569d4e8e1 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:04.569405 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-19b72b08-c800-49d9-9c3b-ab5569d4e8e1 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:04.570252 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-19b72b08-c800-49d9-9c3b-ab5569d4e8e1 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:04.570784 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-19b72b08-c800-49d9-9c3b-ab5569d4e8e1 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:04.692159 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-19b72b08-c800-49d9-9c3b-ab5569d4e8e1 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a41fbfb1db4c2c8bb0c9ef8020a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910b734a3aa343fb9c79c6f1ae1ed425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:04.703135 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-19b72b08-c800-49d9-9c3b-ab5569d4e8e1 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] 10.222.0.35 "GET /compute/v2.1/servers/17932a8a-0c0c-4510-85ad-98dbf1a77bdc" status: 200 len: 1265 microversion: 2.1 time: 0.146881 Aug 07 04:56:04.703727 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 179/397] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:04 2021] GET /compute/v2.1/servers/17932a8a-0c0c-4510-85ad-98dbf1a77bdc => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:56:04.708228 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-53167aca-cc2d-4bd8-b71b-09a9618f7065 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:04.708876 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-53167aca-cc2d-4bd8-b71b-09a9618f7065 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:04.716280 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-53167aca-cc2d-4bd8-b71b-09a9618f7065 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:04.717159 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-53167aca-cc2d-4bd8-b71b-09a9618f7065 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:04.718291 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-53167aca-cc2d-4bd8-b71b-09a9618f7065 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:04.718882 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-53167aca-cc2d-4bd8-b71b-09a9618f7065 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:04.792201 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-53167aca-cc2d-4bd8-b71b-09a9618f7065 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:04.800517 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-53167aca-cc2d-4bd8-b71b-09a9618f7065 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5" status: 200 len: 1222 microversion: 2.1 time: 0.095743 Aug 07 04:56:04.801858 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 180/398] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:04 2021] GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5 => generated 1222 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:56:04.846869 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-6c9f6858-307e-4f2a-95ef-858d7be153b3 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:04.847817 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-6c9f6858-307e-4f2a-95ef-858d7be153b3 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:04.868484 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6c9f6858-307e-4f2a-95ef-858d7be153b3 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:04.869792 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6c9f6858-307e-4f2a-95ef-858d7be153b3 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:04.870649 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6c9f6858-307e-4f2a-95ef-858d7be153b3 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:04.871009 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6c9f6858-307e-4f2a-95ef-858d7be153b3 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:05.091179 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-6c9f6858-307e-4f2a-95ef-858d7be153b3 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:05.101398 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-6c9f6858-307e-4f2a-95ef-858d7be153b3 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1522 microversion: 2.1 time: 0.258366 Aug 07 04:56:05.102002 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 181/399] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:04 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1522 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:56:05.723494 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-e68b3e75-e49a-4e5e-8027-1adef999374d tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:05.724184 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-e68b3e75-e49a-4e5e-8027-1adef999374d tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] [instance: 17932a8a-0c0c-4510-85ad-98dbf1a77bdc] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:05.730218 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e68b3e75-e49a-4e5e-8027-1adef999374d tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:05.730790 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e68b3e75-e49a-4e5e-8027-1adef999374d tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:05.731735 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e68b3e75-e49a-4e5e-8027-1adef999374d tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:05.732232 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e68b3e75-e49a-4e5e-8027-1adef999374d tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:05.795708 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-e68b3e75-e49a-4e5e-8027-1adef999374d tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a41fbfb1db4c2c8bb0c9ef8020a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910b734a3aa343fb9c79c6f1ae1ed425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:05.802792 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-e68b3e75-e49a-4e5e-8027-1adef999374d tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] 10.222.0.35 "GET /compute/v2.1/servers/17932a8a-0c0c-4510-85ad-98dbf1a77bdc" status: 200 len: 1265 microversion: 2.1 time: 0.082933 Aug 07 04:56:05.803347 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 182/400] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:05 2021] GET /compute/v2.1/servers/17932a8a-0c0c-4510-85ad-98dbf1a77bdc => generated 1265 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:56:05.817333 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-3208ad77-35b5-4dbe-b024-589aa5fed143 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:05.817926 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-3208ad77-35b5-4dbe-b024-589aa5fed143 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:05.824812 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3208ad77-35b5-4dbe-b024-589aa5fed143 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:05.824812 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3208ad77-35b5-4dbe-b024-589aa5fed143 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:05.824812 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3208ad77-35b5-4dbe-b024-589aa5fed143 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:05.825241 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3208ad77-35b5-4dbe-b024-589aa5fed143 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:05.886748 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-3208ad77-35b5-4dbe-b024-589aa5fed143 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:05.894290 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-3208ad77-35b5-4dbe-b024-589aa5fed143 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5" status: 200 len: 1222 microversion: 2.1 time: 0.080326 Aug 07 04:56:05.894948 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 183/401] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:05 2021] GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5 => generated 1222 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:56:06.121079 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-a8401847-5388-470b-88f2-c504be9d9553 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:06.121843 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-a8401847-5388-470b-88f2-c504be9d9553 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:06.127994 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a8401847-5388-470b-88f2-c504be9d9553 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:06.128440 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a8401847-5388-470b-88f2-c504be9d9553 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:06.129286 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a8401847-5388-470b-88f2-c504be9d9553 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:06.129724 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a8401847-5388-470b-88f2-c504be9d9553 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:06.350017 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-a8401847-5388-470b-88f2-c504be9d9553 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:06.359317 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-a8401847-5388-470b-88f2-c504be9d9553 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1522 microversion: 2.1 time: 0.242780 Aug 07 04:56:06.360592 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 184/402] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:06 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:56:06.819537 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-e4f7c00b-568c-47c8-a9b3-2b579e34307e tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:06.820655 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-e4f7c00b-568c-47c8-a9b3-2b579e34307e tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] [instance: 17932a8a-0c0c-4510-85ad-98dbf1a77bdc] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:06.827756 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e4f7c00b-568c-47c8-a9b3-2b579e34307e tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:06.828447 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e4f7c00b-568c-47c8-a9b3-2b579e34307e tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:06.829564 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e4f7c00b-568c-47c8-a9b3-2b579e34307e tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:06.830220 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e4f7c00b-568c-47c8-a9b3-2b579e34307e tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:06.903258 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-e4f7c00b-568c-47c8-a9b3-2b579e34307e tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a41fbfb1db4c2c8bb0c9ef8020a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910b734a3aa343fb9c79c6f1ae1ed425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:06.912025 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-e4f7c00b-568c-47c8-a9b3-2b579e34307e tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] 10.222.0.35 "GET /compute/v2.1/servers/17932a8a-0c0c-4510-85ad-98dbf1a77bdc" status: 200 len: 1265 microversion: 2.1 time: 0.096184 Aug 07 04:56:06.912588 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 185/403] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:06 2021] GET /compute/v2.1/servers/17932a8a-0c0c-4510-85ad-98dbf1a77bdc => generated 1265 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:56:06.927784 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-6310a570-8392-4677-baa4-7fb669e1b2a4 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:06.928401 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-6310a570-8392-4677-baa4-7fb669e1b2a4 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:06.935601 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6310a570-8392-4677-baa4-7fb669e1b2a4 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:06.936045 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6310a570-8392-4677-baa4-7fb669e1b2a4 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:06.936837 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6310a570-8392-4677-baa4-7fb669e1b2a4 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:06.937273 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6310a570-8392-4677-baa4-7fb669e1b2a4 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:06.998620 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-6310a570-8392-4677-baa4-7fb669e1b2a4 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:07.006119 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-6310a570-8392-4677-baa4-7fb669e1b2a4 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5" status: 200 len: 1222 microversion: 2.1 time: 0.081856 Aug 07 04:56:07.006769 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 186/404] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:06 2021] GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5 => generated 1222 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:56:07.378680 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-6ab1564f-328a-4065-9919-0c9c12d74707 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:07.379422 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-6ab1564f-328a-4065-9919-0c9c12d74707 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:07.385858 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6ab1564f-328a-4065-9919-0c9c12d74707 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:07.385858 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6ab1564f-328a-4065-9919-0c9c12d74707 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:07.386673 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6ab1564f-328a-4065-9919-0c9c12d74707 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:07.387349 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6ab1564f-328a-4065-9919-0c9c12d74707 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:07.539134 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-6ab1564f-328a-4065-9919-0c9c12d74707 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:07.549931 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-6ab1564f-328a-4065-9919-0c9c12d74707 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1522 microversion: 2.1 time: 0.176142 Aug 07 04:56:07.556844 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 187/405] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:07 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:56:07.929866 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-4a2aa81c-818a-4e4c-8168-dca9adfc81f4 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:07.930526 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-4a2aa81c-818a-4e4c-8168-dca9adfc81f4 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] [instance: 17932a8a-0c0c-4510-85ad-98dbf1a77bdc] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:07.937975 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4a2aa81c-818a-4e4c-8168-dca9adfc81f4 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:07.938528 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4a2aa81c-818a-4e4c-8168-dca9adfc81f4 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:07.939364 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4a2aa81c-818a-4e4c-8168-dca9adfc81f4 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:07.939832 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4a2aa81c-818a-4e4c-8168-dca9adfc81f4 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:08.031622 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-4a2aa81c-818a-4e4c-8168-dca9adfc81f4 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a41fbfb1db4c2c8bb0c9ef8020a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910b734a3aa343fb9c79c6f1ae1ed425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:08.040769 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-4a2aa81c-818a-4e4c-8168-dca9adfc81f4 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] 10.222.0.35 "GET /compute/v2.1/servers/17932a8a-0c0c-4510-85ad-98dbf1a77bdc" status: 200 len: 1265 microversion: 2.1 time: 0.114784 Aug 07 04:56:08.041416 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 188/406] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:07 2021] GET /compute/v2.1/servers/17932a8a-0c0c-4510-85ad-98dbf1a77bdc => generated 1265 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:56:08.046560 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-d8cc8414-9299-4c6e-95d4-769f65c36e03 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:08.047163 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-d8cc8414-9299-4c6e-95d4-769f65c36e03 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:08.053694 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d8cc8414-9299-4c6e-95d4-769f65c36e03 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:08.054381 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d8cc8414-9299-4c6e-95d4-769f65c36e03 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:08.057200 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d8cc8414-9299-4c6e-95d4-769f65c36e03 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:08.057836 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d8cc8414-9299-4c6e-95d4-769f65c36e03 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:08.144741 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-d8cc8414-9299-4c6e-95d4-769f65c36e03 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:08.166136 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-d8cc8414-9299-4c6e-95d4-769f65c36e03 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5" status: 200 len: 1222 microversion: 2.1 time: 0.119722 Aug 07 04:56:08.175907 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 189/407] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:08 2021] GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5 => generated 1222 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:56:08.570343 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-00a4dac0-7ec6-465d-a9b6-a8ea6905f399 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:08.570943 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-00a4dac0-7ec6-465d-a9b6-a8ea6905f399 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:08.584210 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-00a4dac0-7ec6-465d-a9b6-a8ea6905f399 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:08.585102 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-00a4dac0-7ec6-465d-a9b6-a8ea6905f399 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:08.586897 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-00a4dac0-7ec6-465d-a9b6-a8ea6905f399 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:08.587622 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-00a4dac0-7ec6-465d-a9b6-a8ea6905f399 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:08.911307 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-00a4dac0-7ec6-465d-a9b6-a8ea6905f399 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:08.921580 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-00a4dac0-7ec6-465d-a9b6-a8ea6905f399 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1522 microversion: 2.1 time: 0.354833 Aug 07 04:56:08.922178 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 190/408] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:08 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1522 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:56:09.057460 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-b4d9610b-f897-4d1a-8e62-133bb6f96a14 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:09.058096 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-b4d9610b-f897-4d1a-8e62-133bb6f96a14 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] [instance: 17932a8a-0c0c-4510-85ad-98dbf1a77bdc] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:09.064721 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b4d9610b-f897-4d1a-8e62-133bb6f96a14 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:09.065211 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b4d9610b-f897-4d1a-8e62-133bb6f96a14 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:09.066033 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b4d9610b-f897-4d1a-8e62-133bb6f96a14 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:09.066622 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b4d9610b-f897-4d1a-8e62-133bb6f96a14 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:09.170601 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-b4d9610b-f897-4d1a-8e62-133bb6f96a14 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a41fbfb1db4c2c8bb0c9ef8020a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910b734a3aa343fb9c79c6f1ae1ed425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:09.179308 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-b4d9610b-f897-4d1a-8e62-133bb6f96a14 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] 10.222.0.35 "GET /compute/v2.1/servers/17932a8a-0c0c-4510-85ad-98dbf1a77bdc" status: 200 len: 1265 microversion: 2.1 time: 0.125808 Aug 07 04:56:09.196034 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 191/409] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:09 2021] GET /compute/v2.1/servers/17932a8a-0c0c-4510-85ad-98dbf1a77bdc => generated 1265 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:56:09.203179 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-e1beb0f3-5938-41d2-b780-78c5d6435f45 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:09.208988 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-e1beb0f3-5938-41d2-b780-78c5d6435f45 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:09.218561 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e1beb0f3-5938-41d2-b780-78c5d6435f45 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:09.219603 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e1beb0f3-5938-41d2-b780-78c5d6435f45 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:09.220642 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e1beb0f3-5938-41d2-b780-78c5d6435f45 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:09.221329 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e1beb0f3-5938-41d2-b780-78c5d6435f45 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:09.329989 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-e1beb0f3-5938-41d2-b780-78c5d6435f45 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:09.346491 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-e1beb0f3-5938-41d2-b780-78c5d6435f45 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5" status: 200 len: 1222 microversion: 2.1 time: 0.147811 Aug 07 04:56:09.347080 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 192/410] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:09 2021] GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5 => generated 1222 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:56:09.939515 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-9e4e4396-e170-4a32-9610-5b6e970ad040 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:09.940131 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-9e4e4396-e170-4a32-9610-5b6e970ad040 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:09.960307 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9e4e4396-e170-4a32-9610-5b6e970ad040 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:09.960765 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9e4e4396-e170-4a32-9610-5b6e970ad040 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:09.961600 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9e4e4396-e170-4a32-9610-5b6e970ad040 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:09.965910 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9e4e4396-e170-4a32-9610-5b6e970ad040 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:10.267072 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-9e4e4396-e170-4a32-9610-5b6e970ad040 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:10.275918 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-9e4e4396-e170-4a32-9610-5b6e970ad040 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1522 microversion: 2.1 time: 0.341356 Aug 07 04:56:10.276872 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 193/411] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:09 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1522 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:56:10.290928 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-68fefc6e-34ef-43f5-8c06-e9940a839e89 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:10.291535 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-68fefc6e-34ef-43f5-8c06-e9940a839e89 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] [instance: 17932a8a-0c0c-4510-85ad-98dbf1a77bdc] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:10.298301 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-68fefc6e-34ef-43f5-8c06-e9940a839e89 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:10.298930 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-68fefc6e-34ef-43f5-8c06-e9940a839e89 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:10.299848 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-68fefc6e-34ef-43f5-8c06-e9940a839e89 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:10.300282 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-68fefc6e-34ef-43f5-8c06-e9940a839e89 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:10.397461 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-68fefc6e-34ef-43f5-8c06-e9940a839e89 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a41fbfb1db4c2c8bb0c9ef8020a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910b734a3aa343fb9c79c6f1ae1ed425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:10.405489 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-68fefc6e-34ef-43f5-8c06-e9940a839e89 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] 10.222.0.35 "GET /compute/v2.1/servers/17932a8a-0c0c-4510-85ad-98dbf1a77bdc" status: 200 len: 1265 microversion: 2.1 time: 0.127496 Aug 07 04:56:10.406068 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 194/412] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:10 2021] GET /compute/v2.1/servers/17932a8a-0c0c-4510-85ad-98dbf1a77bdc => generated 1265 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:56:10.411169 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-d24845d2-7a47-4a68-b743-45d8bcb04341 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:10.411916 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-d24845d2-7a47-4a68-b743-45d8bcb04341 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:10.420089 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d24845d2-7a47-4a68-b743-45d8bcb04341 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:10.420587 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d24845d2-7a47-4a68-b743-45d8bcb04341 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:10.421958 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d24845d2-7a47-4a68-b743-45d8bcb04341 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:10.423810 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d24845d2-7a47-4a68-b743-45d8bcb04341 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:10.531841 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-d24845d2-7a47-4a68-b743-45d8bcb04341 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:10.543942 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-d24845d2-7a47-4a68-b743-45d8bcb04341 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5" status: 200 len: 1222 microversion: 2.1 time: 0.136822 Aug 07 04:56:10.544611 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 195/413] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:10 2021] GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5 => generated 1222 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:56:11.424268 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-de54972b-f58d-4030-a863-c5342830b810 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Action: 'create', calling method: .version_select at 0x7f75f8177310>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1125723205"}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:56:11.441691 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.quota [None req-de54972b-f58d-4030-a863-c5342830b810 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Getting quotas for project e90cab30a20644dbabb505e1ada2dc3a. Resources: {'key_pairs'} {{(pid=107485) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 07 04:56:11.445412 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.quota [None req-de54972b-f58d-4030-a863-c5342830b810 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Getting quotas for user 1c71b131fcdb495d829a615ebae65aaa and project e90cab30a20644dbabb505e1ada2dc3a. Resources: {'key_pairs'} {{(pid=107485) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 07 04:56:11.615811 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.quota [None req-de54972b-f58d-4030-a863-c5342830b810 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Getting quotas for project e90cab30a20644dbabb505e1ada2dc3a. Resources: {'key_pairs'} {{(pid=107485) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 07 04:56:11.619514 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.quota [None req-de54972b-f58d-4030-a863-c5342830b810 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Getting quotas for user 1c71b131fcdb495d829a615ebae65aaa and project e90cab30a20644dbabb505e1ada2dc3a. Resources: {'key_pairs'} {{(pid=107485) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 07 04:56:11.632477 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-de54972b-f58d-4030-a863-c5342830b810 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.383284 Aug 07 04:56:11.633110 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 196/414] 10.222.0.35 () {60 vars in 1158 bytes} [Sat Aug 7 04:56:11 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:56:11.638459 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-6880f21c-3355-43f0-bd6b-5446c34c9fcb tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:11.639064 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-6880f21c-3355-43f0-bd6b-5446c34c9fcb tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:11.644977 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6880f21c-3355-43f0-bd6b-5446c34c9fcb tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:11.645441 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6880f21c-3355-43f0-bd6b-5446c34c9fcb tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:11.646310 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6880f21c-3355-43f0-bd6b-5446c34c9fcb tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:11.646612 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6880f21c-3355-43f0-bd6b-5446c34c9fcb tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:11.808304 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-6880f21c-3355-43f0-bd6b-5446c34c9fcb tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:11.815622 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-6880f21c-3355-43f0-bd6b-5446c34c9fcb tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1522 microversion: 2.1 time: 0.181552 Aug 07 04:56:11.816191 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 197/415] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:11 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:56:11.820408 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-1a15fb5f-de74-46c0-9fe8-70c43b505408 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:11.821071 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-1a15fb5f-de74-46c0-9fe8-70c43b505408 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] [instance: 17932a8a-0c0c-4510-85ad-98dbf1a77bdc] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:11.828009 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1a15fb5f-de74-46c0-9fe8-70c43b505408 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:11.828455 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1a15fb5f-de74-46c0-9fe8-70c43b505408 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:11.829267 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1a15fb5f-de74-46c0-9fe8-70c43b505408 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:11.829695 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1a15fb5f-de74-46c0-9fe8-70c43b505408 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:11.900730 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-1a15fb5f-de74-46c0-9fe8-70c43b505408 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a41fbfb1db4c2c8bb0c9ef8020a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910b734a3aa343fb9c79c6f1ae1ed425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:11.909783 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-1a15fb5f-de74-46c0-9fe8-70c43b505408 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] 10.222.0.35 "GET /compute/v2.1/servers/17932a8a-0c0c-4510-85ad-98dbf1a77bdc" status: 200 len: 1265 microversion: 2.1 time: 0.092595 Aug 07 04:56:11.910576 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 198/416] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:11 2021] GET /compute/v2.1/servers/17932a8a-0c0c-4510-85ad-98dbf1a77bdc => generated 1265 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:56:11.915045 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-eefa61c7-b382-4935-9332-b2e46c8d3503 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:11.915682 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-eefa61c7-b382-4935-9332-b2e46c8d3503 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:11.921663 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-eefa61c7-b382-4935-9332-b2e46c8d3503 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:11.922344 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-eefa61c7-b382-4935-9332-b2e46c8d3503 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:11.923503 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-eefa61c7-b382-4935-9332-b2e46c8d3503 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:11.924084 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-eefa61c7-b382-4935-9332-b2e46c8d3503 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:12.000109 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-eefa61c7-b382-4935-9332-b2e46c8d3503 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:12.008973 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-eefa61c7-b382-4935-9332-b2e46c8d3503 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5" status: 200 len: 1222 microversion: 2.1 time: 0.096404 Aug 07 04:56:12.009978 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 199/417] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:11 2021] GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5 => generated 1222 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:56:12.832751 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-93743727-e90a-4e7b-bdf8-f7705b8a11b5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:12.833444 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-93743727-e90a-4e7b-bdf8-f7705b8a11b5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:12.840195 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-93743727-e90a-4e7b-bdf8-f7705b8a11b5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:12.840617 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-93743727-e90a-4e7b-bdf8-f7705b8a11b5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:12.841476 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-93743727-e90a-4e7b-bdf8-f7705b8a11b5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:12.841916 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-93743727-e90a-4e7b-bdf8-f7705b8a11b5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:12.971377 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-93743727-e90a-4e7b-bdf8-f7705b8a11b5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:12.980685 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-93743727-e90a-4e7b-bdf8-f7705b8a11b5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1522 microversion: 2.1 time: 0.151397 Aug 07 04:56:13.003062 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 200/418] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:12 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:56:13.011401 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-65e498ca-302d-43c9-8f2f-d38445da13a9 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:13.012350 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-65e498ca-302d-43c9-8f2f-d38445da13a9 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] [instance: 17932a8a-0c0c-4510-85ad-98dbf1a77bdc] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:13.021295 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-65e498ca-302d-43c9-8f2f-d38445da13a9 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:13.022056 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-65e498ca-302d-43c9-8f2f-d38445da13a9 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:13.023327 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-65e498ca-302d-43c9-8f2f-d38445da13a9 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:13.023914 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-65e498ca-302d-43c9-8f2f-d38445da13a9 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:13.063913 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-8512bf20-f9e3-462d-aeb0-215ece4b1078 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 28634 microversion: 2.20 time: 8.934801 Aug 07 04:56:13.065983 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 219/419] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:56:04 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 28634 bytes in 8938 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:56:13.072054 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-1e06a643-4c7a-49b3-8b70-80c333dd4caa tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:13.073138 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-1e06a643-4c7a-49b3-8b70-80c333dd4caa tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:13.082261 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1e06a643-4c7a-49b3-8b70-80c333dd4caa tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:13.083061 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1e06a643-4c7a-49b3-8b70-80c333dd4caa tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:13.084114 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1e06a643-4c7a-49b3-8b70-80c333dd4caa tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:13.084865 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1e06a643-4c7a-49b3-8b70-80c333dd4caa tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:13.130043 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-65e498ca-302d-43c9-8f2f-d38445da13a9 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a41fbfb1db4c2c8bb0c9ef8020a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910b734a3aa343fb9c79c6f1ae1ed425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:13.140234 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-65e498ca-302d-43c9-8f2f-d38445da13a9 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] 10.222.0.35 "GET /compute/v2.1/servers/17932a8a-0c0c-4510-85ad-98dbf1a77bdc" status: 200 len: 1265 microversion: 2.1 time: 0.134309 Aug 07 04:56:13.141580 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 201/420] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:13 2021] GET /compute/v2.1/servers/17932a8a-0c0c-4510-85ad-98dbf1a77bdc => generated 1265 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:56:13.176575 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-1e06a643-4c7a-49b3-8b70-80c333dd4caa tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:13.192295 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-1e06a643-4c7a-49b3-8b70-80c333dd4caa tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5" status: 200 len: 1222 microversion: 2.1 time: 0.124338 Aug 07 04:56:13.192965 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 220/421] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:13 2021] GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5 => generated 1222 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:56:14.000576 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-f5d3cbd6-a136-4274-b047-91b5a9395af5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:14.002484 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-f5d3cbd6-a136-4274-b047-91b5a9395af5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:14.011644 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f5d3cbd6-a136-4274-b047-91b5a9395af5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:14.012391 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f5d3cbd6-a136-4274-b047-91b5a9395af5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:14.013441 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f5d3cbd6-a136-4274-b047-91b5a9395af5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:14.013878 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f5d3cbd6-a136-4274-b047-91b5a9395af5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:14.077332 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-3d60522f-d15a-4945-8e40-e122b1262473 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:56:14.078641 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-3d60522f-d15a-4945-8e40-e122b1262473 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:14.096400 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3d60522f-d15a-4945-8e40-e122b1262473 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:14.098850 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3d60522f-d15a-4945-8e40-e122b1262473 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:14.099931 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3d60522f-d15a-4945-8e40-e122b1262473 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:14.101635 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3d60522f-d15a-4945-8e40-e122b1262473 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:14.269913 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-f5d3cbd6-a136-4274-b047-91b5a9395af5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:14.291615 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-f5d3cbd6-a136-4274-b047-91b5a9395af5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1522 microversion: 2.1 time: 0.295133 Aug 07 04:56:14.300893 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 202/422] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:13 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1522 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:56:14.301349 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-8a9eeaad-0ee8-43c8-8d25-b3fc484c0f44 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:14.318677 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-8a9eeaad-0ee8-43c8-8d25-b3fc484c0f44 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] [instance: 17932a8a-0c0c-4510-85ad-98dbf1a77bdc] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:14.326495 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-3d60522f-d15a-4945-8e40-e122b1262473 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 28634 microversion: 2.20 time: 0.253686 Aug 07 04:56:14.327664 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 221/423] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:56:14 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 28634 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 07 04:56:14.332553 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8a9eeaad-0ee8-43c8-8d25-b3fc484c0f44 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:14.334951 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8a9eeaad-0ee8-43c8-8d25-b3fc484c0f44 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:14.336841 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8a9eeaad-0ee8-43c8-8d25-b3fc484c0f44 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:14.342702 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8a9eeaad-0ee8-43c8-8d25-b3fc484c0f44 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:14.353866 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-5a5a2186-889e-4fee-b3c3-c9e78ae6c53c tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:14.354835 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-5a5a2186-889e-4fee-b3c3-c9e78ae6c53c tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:14.375841 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5a5a2186-889e-4fee-b3c3-c9e78ae6c53c tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:14.379903 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5a5a2186-889e-4fee-b3c3-c9e78ae6c53c tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:14.380762 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5a5a2186-889e-4fee-b3c3-c9e78ae6c53c tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:14.385829 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5a5a2186-889e-4fee-b3c3-c9e78ae6c53c tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:14.449388 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-8a9eeaad-0ee8-43c8-8d25-b3fc484c0f44 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a41fbfb1db4c2c8bb0c9ef8020a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910b734a3aa343fb9c79c6f1ae1ed425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:14.458644 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-8a9eeaad-0ee8-43c8-8d25-b3fc484c0f44 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] 10.222.0.35 "GET /compute/v2.1/servers/17932a8a-0c0c-4510-85ad-98dbf1a77bdc" status: 200 len: 1271 microversion: 2.1 time: 0.162478 Aug 07 04:56:14.459352 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 203/424] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:14 2021] GET /compute/v2.1/servers/17932a8a-0c0c-4510-85ad-98dbf1a77bdc => generated 1271 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:56:14.519006 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-5a5a2186-889e-4fee-b3c3-c9e78ae6c53c tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:14.527248 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-5a5a2186-889e-4fee-b3c3-c9e78ae6c53c tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5" status: 200 len: 1270 microversion: 2.1 time: 0.198203 Aug 07 04:56:14.527820 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 222/425] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:14 2021] GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5 => generated 1270 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:56:15.308468 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-569a3806-baf5-4e9d-a78a-46002ba9642a tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:15.309083 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-569a3806-baf5-4e9d-a78a-46002ba9642a tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:15.315074 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-569a3806-baf5-4e9d-a78a-46002ba9642a tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:15.315535 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-569a3806-baf5-4e9d-a78a-46002ba9642a tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:15.316264 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-569a3806-baf5-4e9d-a78a-46002ba9642a tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:15.316692 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-569a3806-baf5-4e9d-a78a-46002ba9642a tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:15.340583 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-e036d99e-b8bd-42c9-89f2-b7faf4a28239 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:56:15.341872 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-e036d99e-b8bd-42c9-89f2-b7faf4a28239 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:15.347977 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e036d99e-b8bd-42c9-89f2-b7faf4a28239 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:15.348505 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e036d99e-b8bd-42c9-89f2-b7faf4a28239 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:15.349378 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e036d99e-b8bd-42c9-89f2-b7faf4a28239 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:15.349884 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e036d99e-b8bd-42c9-89f2-b7faf4a28239 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:15.441429 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-569a3806-baf5-4e9d-a78a-46002ba9642a tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:15.449531 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-569a3806-baf5-4e9d-a78a-46002ba9642a tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1522 microversion: 2.1 time: 0.144887 Aug 07 04:56:15.450110 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 204/426] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:15 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:56:15.474905 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-2e843f00-520d-4766-a322-6db78dc60a7e tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:15.475588 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-2e843f00-520d-4766-a322-6db78dc60a7e tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] [instance: 17932a8a-0c0c-4510-85ad-98dbf1a77bdc] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:15.482256 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2e843f00-520d-4766-a322-6db78dc60a7e tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:15.482699 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2e843f00-520d-4766-a322-6db78dc60a7e tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:15.483494 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2e843f00-520d-4766-a322-6db78dc60a7e tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:15.483943 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2e843f00-520d-4766-a322-6db78dc60a7e tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:15.600727 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-2e843f00-520d-4766-a322-6db78dc60a7e tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a41fbfb1db4c2c8bb0c9ef8020a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910b734a3aa343fb9c79c6f1ae1ed425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:15.608969 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-2e843f00-520d-4766-a322-6db78dc60a7e tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] 10.222.0.35 "GET /compute/v2.1/servers/17932a8a-0c0c-4510-85ad-98dbf1a77bdc" status: 200 len: 1313 microversion: 2.1 time: 0.137556 Aug 07 04:56:15.610086 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 205/427] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:15 2021] GET /compute/v2.1/servers/17932a8a-0c0c-4510-85ad-98dbf1a77bdc => generated 1313 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:56:15.614562 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-592332ec-daf2-4e70-8f5f-efe8a040cd93 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:15.615492 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-592332ec-daf2-4e70-8f5f-efe8a040cd93 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:15.624665 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-592332ec-daf2-4e70-8f5f-efe8a040cd93 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:15.626078 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-592332ec-daf2-4e70-8f5f-efe8a040cd93 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:15.627201 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-592332ec-daf2-4e70-8f5f-efe8a040cd93 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:15.627725 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-592332ec-daf2-4e70-8f5f-efe8a040cd93 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:15.686395 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-e036d99e-b8bd-42c9-89f2-b7faf4a28239 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 28634 microversion: 2.20 time: 0.349525 Aug 07 04:56:15.686395 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 223/428] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:56:15 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 28634 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 07 04:56:15.709070 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-592332ec-daf2-4e70-8f5f-efe8a040cd93 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:15.717558 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-592332ec-daf2-4e70-8f5f-efe8a040cd93 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5" status: 200 len: 1288 microversion: 2.1 time: 0.106193 Aug 07 04:56:15.718153 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 206/429] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:15 2021] GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5 => generated 1288 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:56:16.468131 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-5876ef40-5a47-4afd-9a10-c4e117e427e0 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:16.468862 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-5876ef40-5a47-4afd-9a10-c4e117e427e0 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:16.476015 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5876ef40-5a47-4afd-9a10-c4e117e427e0 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:16.476460 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5876ef40-5a47-4afd-9a10-c4e117e427e0 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:16.477261 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5876ef40-5a47-4afd-9a10-c4e117e427e0 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:16.477823 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5876ef40-5a47-4afd-9a10-c4e117e427e0 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:16.586590 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [req-5fd8271f-a441-413d-9ce6-4244b98efaba req-986f2b86-0465-4af6-a398-bb5a3669f6d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17932a8a-0c0c-4510-85ad-98dbf1a77bdc", "tag": "22b74cd5-b343-4ab5-9067-d22686f86c83"}]} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:56:16.590016 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 04:56:16.590016 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: warnings.warn(msg) Aug 07 04:56:16.616808 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-5fd8271f-a441-413d-9ce6-4244b98efaba req-986f2b86-0465-4af6-a398-bb5a3669f6d5 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:16.624423 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-5fd8271f-a441-413d-9ce6-4244b98efaba req-986f2b86-0465-4af6-a398-bb5a3669f6d5 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:16.645175 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.compute.server_external_events [req-5fd8271f-a441-413d-9ce6-4244b98efaba req-986f2b86-0465-4af6-a398-bb5a3669f6d5 service nova] Creating event network-changed:22b74cd5-b343-4ab5-9067-d22686f86c83 for instance 17932a8a-0c0c-4510-85ad-98dbf1a77bdc on hv-cinder-80374 Aug 07 04:56:16.655955 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [req-5fd8271f-a441-413d-9ce6-4244b98efaba req-986f2b86-0465-4af6-a398-bb5a3669f6d5 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073114 Aug 07 04:56:16.656554 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 207/430] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 04:56:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 04:56:16.661690 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-200c2140-9b1b-4ba0-a58a-59a443e81aa9 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:16.662383 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-200c2140-9b1b-4ba0-a58a-59a443e81aa9 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] [instance: 17932a8a-0c0c-4510-85ad-98dbf1a77bdc] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:16.669087 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-200c2140-9b1b-4ba0-a58a-59a443e81aa9 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:16.669527 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-200c2140-9b1b-4ba0-a58a-59a443e81aa9 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:16.670295 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-200c2140-9b1b-4ba0-a58a-59a443e81aa9 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:16.670723 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-200c2140-9b1b-4ba0-a58a-59a443e81aa9 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:16.691485 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-5876ef40-5a47-4afd-9a10-c4e117e427e0 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:16.703591 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-5876ef40-5a47-4afd-9a10-c4e117e427e0 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1522 microversion: 2.1 time: 0.240685 Aug 07 04:56:16.704182 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 224/431] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:16 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:56:16.719644 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-8fe49709-45b5-4341-841a-3187c0860017 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:56:16.720577 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-8fe49709-45b5-4341-841a-3187c0860017 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:16.730721 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8fe49709-45b5-4341-841a-3187c0860017 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:16.731331 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8fe49709-45b5-4341-841a-3187c0860017 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:16.732134 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8fe49709-45b5-4341-841a-3187c0860017 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:16.732569 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8fe49709-45b5-4341-841a-3187c0860017 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:16.922729 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-200c2140-9b1b-4ba0-a58a-59a443e81aa9 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a41fbfb1db4c2c8bb0c9ef8020a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910b734a3aa343fb9c79c6f1ae1ed425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:16.930527 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-200c2140-9b1b-4ba0-a58a-59a443e81aa9 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] 10.222.0.35 "GET /compute/v2.1/servers/17932a8a-0c0c-4510-85ad-98dbf1a77bdc" status: 200 len: 1313 microversion: 2.1 time: 0.272799 Aug 07 04:56:16.932264 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 208/432] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:16 2021] GET /compute/v2.1/servers/17932a8a-0c0c-4510-85ad-98dbf1a77bdc => generated 1313 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:56:16.936758 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-2e893d0d-7ddb-40a5-a6b2-1ac81f67d0da tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:16.937403 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-2e893d0d-7ddb-40a5-a6b2-1ac81f67d0da tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:16.944919 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2e893d0d-7ddb-40a5-a6b2-1ac81f67d0da tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:16.945363 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2e893d0d-7ddb-40a5-a6b2-1ac81f67d0da tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:16.946142 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2e893d0d-7ddb-40a5-a6b2-1ac81f67d0da tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:16.946578 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2e893d0d-7ddb-40a5-a6b2-1ac81f67d0da tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:16.965451 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-8fe49709-45b5-4341-841a-3187c0860017 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 28634 microversion: 2.20 time: 0.259219 Aug 07 04:56:16.969967 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 225/433] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:56:16 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 28634 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:56:17.158722 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [req-602556f6-c3f4-4c6e-9242-7a84abec9e55 req-15db0f5f-10fc-4163-9cc6-94e87ec3a0e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5", "tag": "1e777704-a54d-44cc-8174-3b1b99eb2c91"}]} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:56:17.160454 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 04:56:17.160454 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: warnings.warn(msg) Aug 07 04:56:17.173862 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-2e893d0d-7ddb-40a5-a6b2-1ac81f67d0da tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:17.184238 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-2e893d0d-7ddb-40a5-a6b2-1ac81f67d0da tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5" status: 200 len: 1318 microversion: 2.1 time: 0.250920 Aug 07 04:56:17.185725 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 209/434] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:16 2021] GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5 => generated 1318 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:56:17.192173 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-602556f6-c3f4-4c6e-9242-7a84abec9e55 req-15db0f5f-10fc-4163-9cc6-94e87ec3a0e9 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:17.192618 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-602556f6-c3f4-4c6e-9242-7a84abec9e55 req-15db0f5f-10fc-4163-9cc6-94e87ec3a0e9 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:17.207601 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.compute.server_external_events [req-602556f6-c3f4-4c6e-9242-7a84abec9e55 req-15db0f5f-10fc-4163-9cc6-94e87ec3a0e9 service nova] Creating event network-changed:1e777704-a54d-44cc-8174-3b1b99eb2c91 for instance 5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5 on hv-cinder-80374 Aug 07 04:56:17.217058 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [req-602556f6-c3f4-4c6e-9242-7a84abec9e55 req-15db0f5f-10fc-4163-9cc6-94e87ec3a0e9 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058225 Aug 07 04:56:17.218013 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 226/435] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 04:56:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:56:17.721167 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-dca8961c-3be0-4cd7-bc20-f03f283477b6 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:17.722393 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-dca8961c-3be0-4cd7-bc20-f03f283477b6 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:17.733892 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-dca8961c-3be0-4cd7-bc20-f03f283477b6 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:17.734476 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-dca8961c-3be0-4cd7-bc20-f03f283477b6 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:17.735379 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-dca8961c-3be0-4cd7-bc20-f03f283477b6 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:17.735899 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-dca8961c-3be0-4cd7-bc20-f03f283477b6 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:17.866978 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-dca8961c-3be0-4cd7-bc20-f03f283477b6 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:17.874820 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-dca8961c-3be0-4cd7-bc20-f03f283477b6 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1502 microversion: 2.1 time: 0.157414 Aug 07 04:56:17.875380 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 210/436] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:17 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1502 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:56:17.892245 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-8a0bf18c-6899-4fd5-92f6-5467ba070796 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "36be6df3-eaf8-4dcb-87e4-5a91a7dcded5"}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:56:17.893411 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-8a0bf18c-6899-4fd5-92f6-5467ba070796 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:17.899711 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8a0bf18c-6899-4fd5-92f6-5467ba070796 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:17.900321 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8a0bf18c-6899-4fd5-92f6-5467ba070796 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:17.901246 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8a0bf18c-6899-4fd5-92f6-5467ba070796 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:17.901683 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8a0bf18c-6899-4fd5-92f6-5467ba070796 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:17.927040 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.wsgi [None req-8a0bf18c-6899-4fd5-92f6-5467ba070796 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] HTTP exception thrown: Cannot 'attach_volume' instance 90d6eef5-1c82-472b-adfb-aeaa1e93d502 while it is in vm_state rescued Aug 07 04:56:17.927882 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-8a0bf18c-6899-4fd5-92f6-5467ba070796 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Returning 409 to user: Cannot 'attach_volume' instance 90d6eef5-1c82-472b-adfb-aeaa1e93d502 while it is in vm_state rescued {{(pid=107486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 07 04:56:17.928714 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-8a0bf18c-6899-4fd5-92f6-5467ba070796 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "POST /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.040745 Aug 07 04:56:17.929549 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 227/437] 10.222.0.35 () {60 vars in 1323 bytes} [Sat Aug 7 04:56:17 2021] POST /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502/os-volume_attachments => generated 152 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 07 04:56:17.938282 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-25f6f570-2ba3-4e07-bcd0-fa437e7ca65f tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:56:17.938802 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-25f6f570-2ba3-4e07-bcd0-fa437e7ca65f tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:17.944605 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-25f6f570-2ba3-4e07-bcd0-fa437e7ca65f tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:17.945074 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-25f6f570-2ba3-4e07-bcd0-fa437e7ca65f tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:17.946035 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-25f6f570-2ba3-4e07-bcd0-fa437e7ca65f tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:17.947073 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-25f6f570-2ba3-4e07-bcd0-fa437e7ca65f tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:17.948592 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-7bc037dd-ff96-48bf-81d7-44c60c038898 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:17.949322 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-7bc037dd-ff96-48bf-81d7-44c60c038898 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] [instance: 17932a8a-0c0c-4510-85ad-98dbf1a77bdc] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:17.955396 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-7bc037dd-ff96-48bf-81d7-44c60c038898 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:17.956038 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-7bc037dd-ff96-48bf-81d7-44c60c038898 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:17.957033 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-7bc037dd-ff96-48bf-81d7-44c60c038898 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:17.957623 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-7bc037dd-ff96-48bf-81d7-44c60c038898 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:18.023920 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-25f6f570-2ba3-4e07-bcd0-fa437e7ca65f tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "POST /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502/action" status: 202 len: 0 microversion: 2.1 time: 0.089138 Aug 07 04:56:18.028192 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 211/438] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 04:56:17 2021] POST /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:56:18.033711 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-c5261a16-673b-4271-87b0-d99bf277fa5d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:56:18.034999 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-c5261a16-673b-4271-87b0-d99bf277fa5d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:18.042255 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c5261a16-673b-4271-87b0-d99bf277fa5d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:18.043112 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c5261a16-673b-4271-87b0-d99bf277fa5d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:18.044265 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c5261a16-673b-4271-87b0-d99bf277fa5d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:18.045203 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c5261a16-673b-4271-87b0-d99bf277fa5d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:18.123325 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-7bc037dd-ff96-48bf-81d7-44c60c038898 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a41fbfb1db4c2c8bb0c9ef8020a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910b734a3aa343fb9c79c6f1ae1ed425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:18.130564 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-7bc037dd-ff96-48bf-81d7-44c60c038898 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] 10.222.0.35 "GET /compute/v2.1/servers/17932a8a-0c0c-4510-85ad-98dbf1a77bdc" status: 200 len: 1313 microversion: 2.1 time: 0.187012 Aug 07 04:56:18.131112 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 228/439] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:17 2021] GET /compute/v2.1/servers/17932a8a-0c0c-4510-85ad-98dbf1a77bdc => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:56:18.136376 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-5afc39ee-d758-459b-a93c-5f6598a27ae7 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:18.137010 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-5afc39ee-d758-459b-a93c-5f6598a27ae7 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:18.142434 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5afc39ee-d758-459b-a93c-5f6598a27ae7 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:18.142879 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5afc39ee-d758-459b-a93c-5f6598a27ae7 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:18.143644 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5afc39ee-d758-459b-a93c-5f6598a27ae7 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:18.144141 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5afc39ee-d758-459b-a93c-5f6598a27ae7 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:18.434912 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-5afc39ee-d758-459b-a93c-5f6598a27ae7 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:18.437411 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-c5261a16-673b-4271-87b0-d99bf277fa5d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 28634 microversion: 2.20 time: 0.407595 Aug 07 04:56:18.438673 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 212/440] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:56:18 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 28634 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:56:18.443291 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-a5388bd2-4a14-4ff3-a375-568fc8bf8757 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:18.445184 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-a5388bd2-4a14-4ff3-a375-568fc8bf8757 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:18.445670 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-5afc39ee-d758-459b-a93c-5f6598a27ae7 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1510 microversion: 2.1 time: 0.313535 Aug 07 04:56:18.446293 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 229/441] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:18 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1510 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:56:18.458789 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a5388bd2-4a14-4ff3-a375-568fc8bf8757 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:18.459237 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a5388bd2-4a14-4ff3-a375-568fc8bf8757 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:18.460024 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a5388bd2-4a14-4ff3-a375-568fc8bf8757 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:18.460473 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a5388bd2-4a14-4ff3-a375-568fc8bf8757 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:18.617022 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-a5388bd2-4a14-4ff3-a375-568fc8bf8757 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:18.624931 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-a5388bd2-4a14-4ff3-a375-568fc8bf8757 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5" status: 200 len: 1318 microversion: 2.1 time: 0.185480 Aug 07 04:56:18.625913 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 213/442] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:18 2021] GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5 => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:56:19.147562 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-2680656f-ca47-4c04-a064-192b376a25b2 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:19.148959 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-2680656f-ca47-4c04-a064-192b376a25b2 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] [instance: 17932a8a-0c0c-4510-85ad-98dbf1a77bdc] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:19.155379 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2680656f-ca47-4c04-a064-192b376a25b2 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:19.155806 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2680656f-ca47-4c04-a064-192b376a25b2 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:19.156601 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2680656f-ca47-4c04-a064-192b376a25b2 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:19.157056 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2680656f-ca47-4c04-a064-192b376a25b2 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:19.294519 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-2680656f-ca47-4c04-a064-192b376a25b2 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a41fbfb1db4c2c8bb0c9ef8020a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910b734a3aa343fb9c79c6f1ae1ed425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:19.301764 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-2680656f-ca47-4c04-a064-192b376a25b2 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] 10.222.0.35 "GET /compute/v2.1/servers/17932a8a-0c0c-4510-85ad-98dbf1a77bdc" status: 200 len: 1313 microversion: 2.1 time: 0.157934 Aug 07 04:56:19.302316 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 230/443] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:19 2021] GET /compute/v2.1/servers/17932a8a-0c0c-4510-85ad-98dbf1a77bdc => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:56:19.451061 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-e690637f-76c8-4630-88f2-7399ba0d5dee tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:56:19.452211 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-e690637f-76c8-4630-88f2-7399ba0d5dee tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:19.459329 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e690637f-76c8-4630-88f2-7399ba0d5dee tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:19.459843 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e690637f-76c8-4630-88f2-7399ba0d5dee tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:19.460729 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e690637f-76c8-4630-88f2-7399ba0d5dee tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:19.461286 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e690637f-76c8-4630-88f2-7399ba0d5dee tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:19.464164 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-ad4c6fa7-ac81-4f51-b544-70a953d01b12 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:19.465075 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-ad4c6fa7-ac81-4f51-b544-70a953d01b12 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:19.471363 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ad4c6fa7-ac81-4f51-b544-70a953d01b12 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:19.471811 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ad4c6fa7-ac81-4f51-b544-70a953d01b12 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:19.472628 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ad4c6fa7-ac81-4f51-b544-70a953d01b12 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:19.473091 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ad4c6fa7-ac81-4f51-b544-70a953d01b12 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:19.603072 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-ad4c6fa7-ac81-4f51-b544-70a953d01b12 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:19.610635 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-ad4c6fa7-ac81-4f51-b544-70a953d01b12 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1510 microversion: 2.1 time: 0.151865 Aug 07 04:56:19.620568 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 231/444] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:19 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:56:19.626157 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-e690637f-76c8-4630-88f2-7399ba0d5dee tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 28634 microversion: 2.20 time: 0.177327 Aug 07 04:56:19.626157 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 214/445] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:56:19 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 28634 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 07 04:56:19.643352 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-a83a894a-82a5-475a-8206-25fc1bbe69cd tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:19.643970 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-a83a894a-82a5-475a-8206-25fc1bbe69cd tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:19.651092 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a83a894a-82a5-475a-8206-25fc1bbe69cd tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:19.651542 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a83a894a-82a5-475a-8206-25fc1bbe69cd tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:19.652335 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a83a894a-82a5-475a-8206-25fc1bbe69cd tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:19.652771 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a83a894a-82a5-475a-8206-25fc1bbe69cd tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:19.820224 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-a83a894a-82a5-475a-8206-25fc1bbe69cd tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:19.829377 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-a83a894a-82a5-475a-8206-25fc1bbe69cd tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5" status: 200 len: 1318 microversion: 2.1 time: 0.190389 Aug 07 04:56:19.839989 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 232/446] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:19 2021] GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5 => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:56:20.319844 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-d5351d7a-c759-4d1d-8f6a-c0bb52e2819a tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:20.320604 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-d5351d7a-c759-4d1d-8f6a-c0bb52e2819a tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] [instance: 17932a8a-0c0c-4510-85ad-98dbf1a77bdc] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:20.327204 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d5351d7a-c759-4d1d-8f6a-c0bb52e2819a tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:20.327649 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d5351d7a-c759-4d1d-8f6a-c0bb52e2819a tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:20.328435 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d5351d7a-c759-4d1d-8f6a-c0bb52e2819a tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:20.328893 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d5351d7a-c759-4d1d-8f6a-c0bb52e2819a tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:20.456905 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-d5351d7a-c759-4d1d-8f6a-c0bb52e2819a tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a41fbfb1db4c2c8bb0c9ef8020a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910b734a3aa343fb9c79c6f1ae1ed425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:20.465628 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-d5351d7a-c759-4d1d-8f6a-c0bb52e2819a tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] 10.222.0.35 "GET /compute/v2.1/servers/17932a8a-0c0c-4510-85ad-98dbf1a77bdc" status: 200 len: 1313 microversion: 2.1 time: 0.149661 Aug 07 04:56:20.466365 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 215/447] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:20 2021] GET /compute/v2.1/servers/17932a8a-0c0c-4510-85ad-98dbf1a77bdc => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:56:20.627235 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-6fb5507a-a926-4bd3-bdfc-be7607aefc8d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:20.627823 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-6fb5507a-a926-4bd3-bdfc-be7607aefc8d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:20.634563 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6fb5507a-a926-4bd3-bdfc-be7607aefc8d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:20.635069 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6fb5507a-a926-4bd3-bdfc-be7607aefc8d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:20.635788 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6fb5507a-a926-4bd3-bdfc-be7607aefc8d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:20.636221 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6fb5507a-a926-4bd3-bdfc-be7607aefc8d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:20.638113 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-a98341c5-d57f-44d2-b662-c444cf704bce tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:56:20.639378 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-a98341c5-d57f-44d2-b662-c444cf704bce tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:20.645231 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a98341c5-d57f-44d2-b662-c444cf704bce tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:20.645784 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a98341c5-d57f-44d2-b662-c444cf704bce tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:20.646627 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a98341c5-d57f-44d2-b662-c444cf704bce tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:20.647288 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a98341c5-d57f-44d2-b662-c444cf704bce tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:20.783581 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-6fb5507a-a926-4bd3-bdfc-be7607aefc8d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:20.791698 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-6fb5507a-a926-4bd3-bdfc-be7607aefc8d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1510 microversion: 2.1 time: 0.168070 Aug 07 04:56:20.792269 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 233/448] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:20 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1510 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:56:20.848755 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-b6639d83-e81a-40d8-a1c1-aaa0e801ecf5 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:20.849877 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-b6639d83-e81a-40d8-a1c1-aaa0e801ecf5 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:20.861611 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b6639d83-e81a-40d8-a1c1-aaa0e801ecf5 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:20.862280 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b6639d83-e81a-40d8-a1c1-aaa0e801ecf5 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:20.866293 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b6639d83-e81a-40d8-a1c1-aaa0e801ecf5 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:20.866747 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b6639d83-e81a-40d8-a1c1-aaa0e801ecf5 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:20.870786 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-a98341c5-d57f-44d2-b662-c444cf704bce tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 28634 microversion: 2.20 time: 0.238151 Aug 07 04:56:20.871781 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 216/449] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:56:20 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 28634 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:56:20.992758 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-b6639d83-e81a-40d8-a1c1-aaa0e801ecf5 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:21.000974 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-b6639d83-e81a-40d8-a1c1-aaa0e801ecf5 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5" status: 200 len: 1318 microversion: 2.1 time: 0.157469 Aug 07 04:56:21.001641 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 234/450] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:20 2021] GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:56:21.482713 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-9c6e3cfc-b9de-455f-aaa2-bbbcea86e341 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:21.483403 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-9c6e3cfc-b9de-455f-aaa2-bbbcea86e341 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] [instance: 17932a8a-0c0c-4510-85ad-98dbf1a77bdc] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:21.490078 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9c6e3cfc-b9de-455f-aaa2-bbbcea86e341 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:21.490522 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9c6e3cfc-b9de-455f-aaa2-bbbcea86e341 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:21.491305 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9c6e3cfc-b9de-455f-aaa2-bbbcea86e341 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:21.491733 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9c6e3cfc-b9de-455f-aaa2-bbbcea86e341 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:21.619686 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-9c6e3cfc-b9de-455f-aaa2-bbbcea86e341 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a41fbfb1db4c2c8bb0c9ef8020a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910b734a3aa343fb9c79c6f1ae1ed425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:21.626897 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-9c6e3cfc-b9de-455f-aaa2-bbbcea86e341 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] 10.222.0.35 "GET /compute/v2.1/servers/17932a8a-0c0c-4510-85ad-98dbf1a77bdc" status: 200 len: 1313 microversion: 2.1 time: 0.148289 Aug 07 04:56:21.627449 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 217/451] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:21 2021] GET /compute/v2.1/servers/17932a8a-0c0c-4510-85ad-98dbf1a77bdc => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:56:21.808540 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-8e904504-cdfc-41a2-b0fc-201bcf6f6a5d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:21.809249 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-8e904504-cdfc-41a2-b0fc-201bcf6f6a5d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:21.815319 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8e904504-cdfc-41a2-b0fc-201bcf6f6a5d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:21.815769 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8e904504-cdfc-41a2-b0fc-201bcf6f6a5d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:21.816544 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8e904504-cdfc-41a2-b0fc-201bcf6f6a5d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:21.817027 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8e904504-cdfc-41a2-b0fc-201bcf6f6a5d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:21.882251 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-96354fbc-0f47-439b-a044-55a961f63efc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:56:21.883147 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-96354fbc-0f47-439b-a044-55a961f63efc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:21.889057 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-96354fbc-0f47-439b-a044-55a961f63efc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:21.889458 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-96354fbc-0f47-439b-a044-55a961f63efc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:21.890216 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-96354fbc-0f47-439b-a044-55a961f63efc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:21.890642 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-96354fbc-0f47-439b-a044-55a961f63efc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:21.943557 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-8e904504-cdfc-41a2-b0fc-201bcf6f6a5d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:21.951598 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-8e904504-cdfc-41a2-b0fc-201bcf6f6a5d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1510 microversion: 2.1 time: 0.147057 Aug 07 04:56:21.952163 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 235/452] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:21 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1510 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:56:22.018086 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-58e2ba74-7cd1-431d-8fe9-892af845fc3d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:22.018684 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-58e2ba74-7cd1-431d-8fe9-892af845fc3d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:22.024860 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-58e2ba74-7cd1-431d-8fe9-892af845fc3d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:22.025260 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-58e2ba74-7cd1-431d-8fe9-892af845fc3d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:22.026020 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-58e2ba74-7cd1-431d-8fe9-892af845fc3d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:22.026445 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-58e2ba74-7cd1-431d-8fe9-892af845fc3d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:22.041584 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-96354fbc-0f47-439b-a044-55a961f63efc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 28634 microversion: 2.20 time: 0.162607 Aug 07 04:56:22.045469 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 218/453] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:56:21 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 28634 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 07 04:56:22.153316 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-58e2ba74-7cd1-431d-8fe9-892af845fc3d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:22.160397 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-58e2ba74-7cd1-431d-8fe9-892af845fc3d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5" status: 200 len: 1318 microversion: 2.1 time: 0.145903 Aug 07 04:56:22.160978 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 236/454] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:22 2021] GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:56:22.643750 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-1cfcf2a7-ca99-4ef1-a542-e2654a1224f5 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:22.644443 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-1cfcf2a7-ca99-4ef1-a542-e2654a1224f5 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] [instance: 17932a8a-0c0c-4510-85ad-98dbf1a77bdc] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:22.651851 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1cfcf2a7-ca99-4ef1-a542-e2654a1224f5 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:22.652621 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1cfcf2a7-ca99-4ef1-a542-e2654a1224f5 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:22.654104 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1cfcf2a7-ca99-4ef1-a542-e2654a1224f5 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:22.654675 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1cfcf2a7-ca99-4ef1-a542-e2654a1224f5 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:22.804403 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-1cfcf2a7-ca99-4ef1-a542-e2654a1224f5 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a41fbfb1db4c2c8bb0c9ef8020a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910b734a3aa343fb9c79c6f1ae1ed425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:22.813272 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-1cfcf2a7-ca99-4ef1-a542-e2654a1224f5 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] 10.222.0.35 "GET /compute/v2.1/servers/17932a8a-0c0c-4510-85ad-98dbf1a77bdc" status: 200 len: 1313 microversion: 2.1 time: 0.173429 Aug 07 04:56:22.814037 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 219/455] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:22 2021] GET /compute/v2.1/servers/17932a8a-0c0c-4510-85ad-98dbf1a77bdc => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:56:22.967999 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-966e4e0b-339c-4496-b41f-79cb8edf1a1e tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:22.968601 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-966e4e0b-339c-4496-b41f-79cb8edf1a1e tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:22.974913 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-966e4e0b-339c-4496-b41f-79cb8edf1a1e tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:22.976531 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-966e4e0b-339c-4496-b41f-79cb8edf1a1e tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:22.976531 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-966e4e0b-339c-4496-b41f-79cb8edf1a1e tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:22.976531 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-966e4e0b-339c-4496-b41f-79cb8edf1a1e tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:23.055171 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-8defc16a-b444-48bf-bf43-7a4164a0c108 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:56:23.056324 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-8defc16a-b444-48bf-bf43-7a4164a0c108 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:23.063133 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8defc16a-b444-48bf-bf43-7a4164a0c108 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:23.063578 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8defc16a-b444-48bf-bf43-7a4164a0c108 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:23.065576 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8defc16a-b444-48bf-bf43-7a4164a0c108 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:23.066225 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8defc16a-b444-48bf-bf43-7a4164a0c108 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:23.139768 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-966e4e0b-339c-4496-b41f-79cb8edf1a1e tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:23.150212 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-966e4e0b-339c-4496-b41f-79cb8edf1a1e tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1510 microversion: 2.1 time: 0.185967 Aug 07 04:56:23.150925 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 237/456] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:22 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1510 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:56:23.177717 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-38cb6584-126b-4d6d-89cb-f47ac3782b52 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:23.178405 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-38cb6584-126b-4d6d-89cb-f47ac3782b52 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:23.184763 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-38cb6584-126b-4d6d-89cb-f47ac3782b52 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:23.185263 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-38cb6584-126b-4d6d-89cb-f47ac3782b52 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:23.186043 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-38cb6584-126b-4d6d-89cb-f47ac3782b52 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:23.186480 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-38cb6584-126b-4d6d-89cb-f47ac3782b52 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:23.297414 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-8defc16a-b444-48bf-bf43-7a4164a0c108 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 28634 microversion: 2.20 time: 0.246697 Aug 07 04:56:23.298351 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 220/457] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:56:23 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 28634 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:56:23.318596 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-38cb6584-126b-4d6d-89cb-f47ac3782b52 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:23.326093 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-38cb6584-126b-4d6d-89cb-f47ac3782b52 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5" status: 200 len: 1318 microversion: 2.1 time: 0.152032 Aug 07 04:56:23.326667 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 238/458] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:23 2021] GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:56:23.831179 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-0ec77c9f-a5ad-4a4f-82e8-78f66c0d1070 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:23.831894 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-0ec77c9f-a5ad-4a4f-82e8-78f66c0d1070 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] [instance: 17932a8a-0c0c-4510-85ad-98dbf1a77bdc] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:23.838638 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0ec77c9f-a5ad-4a4f-82e8-78f66c0d1070 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:23.839084 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0ec77c9f-a5ad-4a4f-82e8-78f66c0d1070 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:23.840116 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0ec77c9f-a5ad-4a4f-82e8-78f66c0d1070 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:23.840547 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0ec77c9f-a5ad-4a4f-82e8-78f66c0d1070 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:23.970719 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-0ec77c9f-a5ad-4a4f-82e8-78f66c0d1070 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a41fbfb1db4c2c8bb0c9ef8020a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910b734a3aa343fb9c79c6f1ae1ed425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:23.980818 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-0ec77c9f-a5ad-4a4f-82e8-78f66c0d1070 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] 10.222.0.35 "GET /compute/v2.1/servers/17932a8a-0c0c-4510-85ad-98dbf1a77bdc" status: 200 len: 1313 microversion: 2.1 time: 0.153527 Aug 07 04:56:23.981409 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 221/459] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:23 2021] GET /compute/v2.1/servers/17932a8a-0c0c-4510-85ad-98dbf1a77bdc => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:56:24.172028 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-8d506698-d953-44c1-80f1-4f22f20573ae tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:24.172646 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-8d506698-d953-44c1-80f1-4f22f20573ae tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:24.178539 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8d506698-d953-44c1-80f1-4f22f20573ae tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:24.178982 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8d506698-d953-44c1-80f1-4f22f20573ae tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:24.179735 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8d506698-d953-44c1-80f1-4f22f20573ae tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:24.180193 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8d506698-d953-44c1-80f1-4f22f20573ae tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:24.309872 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-ecfa2bb1-8c36-45c5-9a30-286ad45c4a39 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:56:24.310870 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-ecfa2bb1-8c36-45c5-9a30-286ad45c4a39 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:24.314292 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-8d506698-d953-44c1-80f1-4f22f20573ae tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:24.316941 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ecfa2bb1-8c36-45c5-9a30-286ad45c4a39 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:24.317650 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ecfa2bb1-8c36-45c5-9a30-286ad45c4a39 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:24.318643 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ecfa2bb1-8c36-45c5-9a30-286ad45c4a39 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:24.319139 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ecfa2bb1-8c36-45c5-9a30-286ad45c4a39 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:24.322250 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-8d506698-d953-44c1-80f1-4f22f20573ae tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1510 microversion: 2.1 time: 0.154243 Aug 07 04:56:24.324340 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 239/460] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:24 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:56:24.346442 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-031eec67-e512-4d32-bd9f-4b097a1e1f27 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:24.347645 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-031eec67-e512-4d32-bd9f-4b097a1e1f27 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:24.354666 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-031eec67-e512-4d32-bd9f-4b097a1e1f27 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:24.355237 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-031eec67-e512-4d32-bd9f-4b097a1e1f27 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:24.356157 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-031eec67-e512-4d32-bd9f-4b097a1e1f27 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:24.356589 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-031eec67-e512-4d32-bd9f-4b097a1e1f27 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:24.486603 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-031eec67-e512-4d32-bd9f-4b097a1e1f27 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:24.498656 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-031eec67-e512-4d32-bd9f-4b097a1e1f27 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5" status: 200 len: 1318 microversion: 2.1 time: 0.157402 Aug 07 04:56:24.502826 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 240/461] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:24 2021] GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:56:24.618542 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-ecfa2bb1-8c36-45c5-9a30-286ad45c4a39 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 28634 microversion: 2.20 time: 0.312226 Aug 07 04:56:24.620549 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 222/462] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:56:24 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 28634 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 07 04:56:25.003420 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-9887ce64-e47b-4fcb-baf1-8cf4240cccc3 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:25.005815 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-9887ce64-e47b-4fcb-baf1-8cf4240cccc3 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] [instance: 17932a8a-0c0c-4510-85ad-98dbf1a77bdc] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:25.014254 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9887ce64-e47b-4fcb-baf1-8cf4240cccc3 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:25.015057 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9887ce64-e47b-4fcb-baf1-8cf4240cccc3 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:25.016053 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9887ce64-e47b-4fcb-baf1-8cf4240cccc3 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:25.016645 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9887ce64-e47b-4fcb-baf1-8cf4240cccc3 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:25.159603 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-9887ce64-e47b-4fcb-baf1-8cf4240cccc3 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a41fbfb1db4c2c8bb0c9ef8020a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910b734a3aa343fb9c79c6f1ae1ed425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:25.168236 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-9887ce64-e47b-4fcb-baf1-8cf4240cccc3 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] 10.222.0.35 "GET /compute/v2.1/servers/17932a8a-0c0c-4510-85ad-98dbf1a77bdc" status: 200 len: 1313 microversion: 2.1 time: 0.175588 Aug 07 04:56:25.168842 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 241/463] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:24 2021] GET /compute/v2.1/servers/17932a8a-0c0c-4510-85ad-98dbf1a77bdc => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:56:25.341426 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-161cfa3e-e9f2-49ab-bb66-99a8a582626f tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:25.342115 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-161cfa3e-e9f2-49ab-bb66-99a8a582626f tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:25.348538 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-161cfa3e-e9f2-49ab-bb66-99a8a582626f tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:25.349014 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-161cfa3e-e9f2-49ab-bb66-99a8a582626f tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:25.349803 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-161cfa3e-e9f2-49ab-bb66-99a8a582626f tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:25.350234 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-161cfa3e-e9f2-49ab-bb66-99a8a582626f tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:25.474709 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-161cfa3e-e9f2-49ab-bb66-99a8a582626f tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:25.482842 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-161cfa3e-e9f2-49ab-bb66-99a8a582626f tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1516 microversion: 2.1 time: 0.146322 Aug 07 04:56:25.483402 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 223/464] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:25 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1516 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:56:25.515966 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-1e95121b-5048-4d93-9862-1db99ce9292a tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:25.516675 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-1e95121b-5048-4d93-9862-1db99ce9292a tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:25.522545 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1e95121b-5048-4d93-9862-1db99ce9292a tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:25.523058 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1e95121b-5048-4d93-9862-1db99ce9292a tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:25.524578 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1e95121b-5048-4d93-9862-1db99ce9292a tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:25.525319 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1e95121b-5048-4d93-9862-1db99ce9292a tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:25.640507 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-d6322f2f-9868-4320-b525-840b6fc51784 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:56:25.641828 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-d6322f2f-9868-4320-b525-840b6fc51784 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:25.648209 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d6322f2f-9868-4320-b525-840b6fc51784 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:25.648774 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d6322f2f-9868-4320-b525-840b6fc51784 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:25.650258 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d6322f2f-9868-4320-b525-840b6fc51784 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:25.650980 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d6322f2f-9868-4320-b525-840b6fc51784 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:25.659260 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-1e95121b-5048-4d93-9862-1db99ce9292a tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:25.667243 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-1e95121b-5048-4d93-9862-1db99ce9292a tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5" status: 200 len: 1318 microversion: 2.1 time: 0.154873 Aug 07 04:56:25.667811 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 242/465] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:25 2021] GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:56:25.809915 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-d6322f2f-9868-4320-b525-840b6fc51784 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 28634 microversion: 2.20 time: 0.183213 Aug 07 04:56:25.810549 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 224/466] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:56:25 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 28634 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 07 04:56:26.185522 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-68cbc17b-427a-48f7-8da7-ed047482650c tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:26.186132 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-68cbc17b-427a-48f7-8da7-ed047482650c tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] [instance: 17932a8a-0c0c-4510-85ad-98dbf1a77bdc] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:26.192141 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-68cbc17b-427a-48f7-8da7-ed047482650c tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:26.192584 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-68cbc17b-427a-48f7-8da7-ed047482650c tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:26.193388 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-68cbc17b-427a-48f7-8da7-ed047482650c tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:26.193820 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-68cbc17b-427a-48f7-8da7-ed047482650c tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:26.315023 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-68cbc17b-427a-48f7-8da7-ed047482650c tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a41fbfb1db4c2c8bb0c9ef8020a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910b734a3aa343fb9c79c6f1ae1ed425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:26.323776 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-68cbc17b-427a-48f7-8da7-ed047482650c tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] 10.222.0.35 "GET /compute/v2.1/servers/17932a8a-0c0c-4510-85ad-98dbf1a77bdc" status: 200 len: 1313 microversion: 2.1 time: 0.141788 Aug 07 04:56:26.324611 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 243/467] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:26 2021] GET /compute/v2.1/servers/17932a8a-0c0c-4510-85ad-98dbf1a77bdc => generated 1313 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:56:26.684909 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-fb7f3358-5e82-4eea-a1bf-324a26386170 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:26.685612 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-fb7f3358-5e82-4eea-a1bf-324a26386170 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:26.692063 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-fb7f3358-5e82-4eea-a1bf-324a26386170 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:26.692508 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-fb7f3358-5e82-4eea-a1bf-324a26386170 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:26.693304 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-fb7f3358-5e82-4eea-a1bf-324a26386170 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:26.693743 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-fb7f3358-5e82-4eea-a1bf-324a26386170 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:26.818722 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-fb7f3358-5e82-4eea-a1bf-324a26386170 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:26.821902 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-6bebb526-fe41-440c-9990-89fab842489d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:56:26.822901 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-6bebb526-fe41-440c-9990-89fab842489d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:26.826648 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-fb7f3358-5e82-4eea-a1bf-324a26386170 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5" status: 200 len: 1318 microversion: 2.1 time: 0.146298 Aug 07 04:56:26.827385 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 225/468] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:26 2021] GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:56:26.842070 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6bebb526-fe41-440c-9990-89fab842489d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:26.842434 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6bebb526-fe41-440c-9990-89fab842489d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:26.843228 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6bebb526-fe41-440c-9990-89fab842489d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:26.843661 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6bebb526-fe41-440c-9990-89fab842489d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:26.934128 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-6bebb526-fe41-440c-9990-89fab842489d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 28634 microversion: 2.20 time: 0.116402 Aug 07 04:56:26.934972 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 244/469] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:56:26 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 28634 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 07 04:56:27.340774 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-4a91a3bb-77cb-409e-b2be-4f8425a9851a tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:27.341407 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-4a91a3bb-77cb-409e-b2be-4f8425a9851a tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] [instance: 17932a8a-0c0c-4510-85ad-98dbf1a77bdc] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:27.347514 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4a91a3bb-77cb-409e-b2be-4f8425a9851a tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:27.348057 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4a91a3bb-77cb-409e-b2be-4f8425a9851a tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:27.348983 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4a91a3bb-77cb-409e-b2be-4f8425a9851a tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:27.349495 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4a91a3bb-77cb-409e-b2be-4f8425a9851a tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:27.472500 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-4a91a3bb-77cb-409e-b2be-4f8425a9851a tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a41fbfb1db4c2c8bb0c9ef8020a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910b734a3aa343fb9c79c6f1ae1ed425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:27.480304 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-4a91a3bb-77cb-409e-b2be-4f8425a9851a tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] 10.222.0.35 "GET /compute/v2.1/servers/17932a8a-0c0c-4510-85ad-98dbf1a77bdc" status: 200 len: 1313 microversion: 2.1 time: 0.144114 Aug 07 04:56:27.480869 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 226/470] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:27 2021] GET /compute/v2.1/servers/17932a8a-0c0c-4510-85ad-98dbf1a77bdc => generated 1313 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:56:27.648647 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [req-0d06d21f-6064-4798-9435-7ea721f6756b req-c5b558f5-0a95-4ed3-8170-cce022b0b5a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5", "name": "network-vif-plugged", "status": "completed", "tag": "1e777704-a54d-44cc-8174-3b1b99eb2c91"}]} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:56:27.651014 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 04:56:27.651014 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: warnings.warn(msg) Aug 07 04:56:27.659152 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-0d06d21f-6064-4798-9435-7ea721f6756b req-c5b558f5-0a95-4ed3-8170-cce022b0b5a5 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:27.659595 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-0d06d21f-6064-4798-9435-7ea721f6756b req-c5b558f5-0a95-4ed3-8170-cce022b0b5a5 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:27.671327 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.compute.server_external_events [req-0d06d21f-6064-4798-9435-7ea721f6756b req-c5b558f5-0a95-4ed3-8170-cce022b0b5a5 service nova] Creating event network-vif-plugged:1e777704-a54d-44cc-8174-3b1b99eb2c91 for instance 5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5 on hv-cinder-80374 Aug 07 04:56:27.675957 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [req-0d06d21f-6064-4798-9435-7ea721f6756b req-c5b558f5-0a95-4ed3-8170-cce022b0b5a5 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031324 Aug 07 04:56:27.676532 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 245/471] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 04:56:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:56:27.844594 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-a00cebe1-e950-46cf-b972-c31a05257480 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:27.845338 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-a00cebe1-e950-46cf-b972-c31a05257480 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:27.851626 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a00cebe1-e950-46cf-b972-c31a05257480 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:27.852266 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a00cebe1-e950-46cf-b972-c31a05257480 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:27.853132 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a00cebe1-e950-46cf-b972-c31a05257480 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:27.853645 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a00cebe1-e950-46cf-b972-c31a05257480 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:27.947574 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-fa8f8ead-1b95-4be5-adfd-7db096e3d232 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:56:27.949337 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-fa8f8ead-1b95-4be5-adfd-7db096e3d232 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:27.956280 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-fa8f8ead-1b95-4be5-adfd-7db096e3d232 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:27.956988 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-fa8f8ead-1b95-4be5-adfd-7db096e3d232 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:27.958091 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-fa8f8ead-1b95-4be5-adfd-7db096e3d232 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:27.958703 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-fa8f8ead-1b95-4be5-adfd-7db096e3d232 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:28.000078 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-a00cebe1-e950-46cf-b972-c31a05257480 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:28.007543 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-a00cebe1-e950-46cf-b972-c31a05257480 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5" status: 200 len: 1318 microversion: 2.1 time: 0.167236 Aug 07 04:56:28.008627 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 227/472] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:27 2021] GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:56:28.012851 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-8d2facbb-d6bf-4020-9930-8aa8aefe68c7 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:28.013445 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-8d2facbb-d6bf-4020-9930-8aa8aefe68c7 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:28.019018 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8d2facbb-d6bf-4020-9930-8aa8aefe68c7 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:28.019459 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8d2facbb-d6bf-4020-9930-8aa8aefe68c7 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:28.020211 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8d2facbb-d6bf-4020-9930-8aa8aefe68c7 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:28.020638 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8d2facbb-d6bf-4020-9930-8aa8aefe68c7 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:28.144103 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-8d2facbb-d6bf-4020-9930-8aa8aefe68c7 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:28.151647 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-8d2facbb-d6bf-4020-9930-8aa8aefe68c7 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1516 microversion: 2.1 time: 0.141983 Aug 07 04:56:28.152222 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 228/473] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:28 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1516 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:56:28.167951 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-6a8ae088-e9e9-4c0a-8a6b-aceb67b89860 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f7a65ce4-134f-4ffa-bae8-835758889e7b"}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:56:28.169106 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-6a8ae088-e9e9-4c0a-8a6b-aceb67b89860 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:28.174837 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6a8ae088-e9e9-4c0a-8a6b-aceb67b89860 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:28.175384 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6a8ae088-e9e9-4c0a-8a6b-aceb67b89860 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:28.176045 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6a8ae088-e9e9-4c0a-8a6b-aceb67b89860 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:28.176478 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6a8ae088-e9e9-4c0a-8a6b-aceb67b89860 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:28.627903 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-fa8f8ead-1b95-4be5-adfd-7db096e3d232 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 28634 microversion: 2.20 time: 0.684849 Aug 07 04:56:28.628553 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 246/474] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:56:27 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 28634 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:56:28.633620 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-1746e38f-a409-43ae-905f-b232a2f0789b tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:28.634314 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-1746e38f-a409-43ae-905f-b232a2f0789b tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] [instance: 17932a8a-0c0c-4510-85ad-98dbf1a77bdc] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:28.641924 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1746e38f-a409-43ae-905f-b232a2f0789b tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:28.642449 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1746e38f-a409-43ae-905f-b232a2f0789b tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:28.643247 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1746e38f-a409-43ae-905f-b232a2f0789b tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:28.643959 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1746e38f-a409-43ae-905f-b232a2f0789b tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:28.780088 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-1746e38f-a409-43ae-905f-b232a2f0789b tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a41fbfb1db4c2c8bb0c9ef8020a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910b734a3aa343fb9c79c6f1ae1ed425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:28.787366 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-1746e38f-a409-43ae-905f-b232a2f0789b tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] 10.222.0.35 "GET /compute/v2.1/servers/17932a8a-0c0c-4510-85ad-98dbf1a77bdc" status: 200 len: 1313 microversion: 2.1 time: 0.157664 Aug 07 04:56:28.787929 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 247/475] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:28 2021] GET /compute/v2.1/servers/17932a8a-0c0c-4510-85ad-98dbf1a77bdc => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:56:28.855525 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-6a8ae088-e9e9-4c0a-8a6b-aceb67b89860 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "POST /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.691636 Aug 07 04:56:28.856347 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 229/476] 10.222.0.35 () {60 vars in 1323 bytes} [Sat Aug 7 04:56:28 2021] POST /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502/os-volume_attachments => generated 194 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 04:56:29.024660 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-43b942b8-0f32-4832-a760-f741550059bc tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:29.025466 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-43b942b8-0f32-4832-a760-f741550059bc tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:29.031311 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-43b942b8-0f32-4832-a760-f741550059bc tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:29.031756 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-43b942b8-0f32-4832-a760-f741550059bc tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:29.032525 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-43b942b8-0f32-4832-a760-f741550059bc tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:29.032994 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-43b942b8-0f32-4832-a760-f741550059bc tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:29.154629 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-43b942b8-0f32-4832-a760-f741550059bc tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:29.161964 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-43b942b8-0f32-4832-a760-f741550059bc tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5" status: 200 len: 1318 microversion: 2.1 time: 0.141590 Aug 07 04:56:29.162633 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 248/477] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:29 2021] GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5 => generated 1318 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:56:29.641074 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-59ab43fe-4bf5-4860-a94a-ac826f39f237 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:56:29.642204 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-59ab43fe-4bf5-4860-a94a-ac826f39f237 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:29.649307 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-59ab43fe-4bf5-4860-a94a-ac826f39f237 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:29.650614 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-59ab43fe-4bf5-4860-a94a-ac826f39f237 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:29.651418 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-59ab43fe-4bf5-4860-a94a-ac826f39f237 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:29.651850 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-59ab43fe-4bf5-4860-a94a-ac826f39f237 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:29.693346 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [req-c3f6c5c3-8f2c-4e63-b4f1-ae15df66401f req-b336fd83-d755-406f-b196-640c0fff6ad7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17932a8a-0c0c-4510-85ad-98dbf1a77bdc", "name": "network-vif-plugged", "status": "completed", "tag": "22b74cd5-b343-4ab5-9067-d22686f86c83"}]} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:56:29.694918 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 04:56:29.694918 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: warnings.warn(msg) Aug 07 04:56:29.702991 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-c3f6c5c3-8f2c-4e63-b4f1-ae15df66401f req-b336fd83-d755-406f-b196-640c0fff6ad7 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:29.703429 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-c3f6c5c3-8f2c-4e63-b4f1-ae15df66401f req-b336fd83-d755-406f-b196-640c0fff6ad7 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:29.715375 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.compute.server_external_events [req-c3f6c5c3-8f2c-4e63-b4f1-ae15df66401f req-b336fd83-d755-406f-b196-640c0fff6ad7 service nova] Creating event network-vif-plugged:22b74cd5-b343-4ab5-9067-d22686f86c83 for instance 17932a8a-0c0c-4510-85ad-98dbf1a77bdc on hv-cinder-80374 Aug 07 04:56:29.719916 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [req-c3f6c5c3-8f2c-4e63-b4f1-ae15df66401f req-b336fd83-d755-406f-b196-640c0fff6ad7 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030258 Aug 07 04:56:29.720463 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 249/478] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 04:56:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 04:56:29.803540 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-59ab43fe-4bf5-4860-a94a-ac826f39f237 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 28634 microversion: 2.20 time: 0.166486 Aug 07 04:56:29.804434 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 230/479] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:56:29 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 28634 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:56:29.804608 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-c0e33df3-3a1b-4997-a33a-1977a195848a tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:29.805800 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-c0e33df3-3a1b-4997-a33a-1977a195848a tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] [instance: 17932a8a-0c0c-4510-85ad-98dbf1a77bdc] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:29.812399 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c0e33df3-3a1b-4997-a33a-1977a195848a tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:29.812865 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c0e33df3-3a1b-4997-a33a-1977a195848a tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:29.813631 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c0e33df3-3a1b-4997-a33a-1977a195848a tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:29.814064 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c0e33df3-3a1b-4997-a33a-1977a195848a tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:29.953823 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-c0e33df3-3a1b-4997-a33a-1977a195848a tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a41fbfb1db4c2c8bb0c9ef8020a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910b734a3aa343fb9c79c6f1ae1ed425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:29.961776 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-c0e33df3-3a1b-4997-a33a-1977a195848a tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] 10.222.0.35 "GET /compute/v2.1/servers/17932a8a-0c0c-4510-85ad-98dbf1a77bdc" status: 200 len: 1313 microversion: 2.1 time: 0.161719 Aug 07 04:56:29.962344 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 250/480] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:29 2021] GET /compute/v2.1/servers/17932a8a-0c0c-4510-85ad-98dbf1a77bdc => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:56:30.179855 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-bf79fd52-f44b-4a65-9cc7-6d6f49b28553 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:30.181416 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-bf79fd52-f44b-4a65-9cc7-6d6f49b28553 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:30.187963 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-bf79fd52-f44b-4a65-9cc7-6d6f49b28553 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:30.188407 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-bf79fd52-f44b-4a65-9cc7-6d6f49b28553 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:30.189206 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-bf79fd52-f44b-4a65-9cc7-6d6f49b28553 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:30.189639 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-bf79fd52-f44b-4a65-9cc7-6d6f49b28553 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:30.313071 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-bf79fd52-f44b-4a65-9cc7-6d6f49b28553 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:30.320226 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-bf79fd52-f44b-4a65-9cc7-6d6f49b28553 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5" status: 200 len: 1318 microversion: 2.1 time: 0.144491 Aug 07 04:56:30.320774 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 231/481] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:30 2021] GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5 => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:56:30.815630 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-cfa21038-f0f8-4773-91b7-e703e1fcef78 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:56:30.816532 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-cfa21038-f0f8-4773-91b7-e703e1fcef78 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:30.822510 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-cfa21038-f0f8-4773-91b7-e703e1fcef78 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:30.822949 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-cfa21038-f0f8-4773-91b7-e703e1fcef78 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:30.823705 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-cfa21038-f0f8-4773-91b7-e703e1fcef78 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:30.824132 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-cfa21038-f0f8-4773-91b7-e703e1fcef78 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:30.959244 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-cfa21038-f0f8-4773-91b7-e703e1fcef78 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 28634 microversion: 2.20 time: 0.147104 Aug 07 04:56:30.960030 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 251/482] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:56:30 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 28634 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:56:30.981694 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-280b0624-dbc8-4faa-a4e5-ff8524709223 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:30.982305 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-280b0624-dbc8-4faa-a4e5-ff8524709223 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] [instance: 17932a8a-0c0c-4510-85ad-98dbf1a77bdc] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:30.988482 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-280b0624-dbc8-4faa-a4e5-ff8524709223 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:30.988954 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-280b0624-dbc8-4faa-a4e5-ff8524709223 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:30.989731 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-280b0624-dbc8-4faa-a4e5-ff8524709223 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:30.990162 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-280b0624-dbc8-4faa-a4e5-ff8524709223 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:31.329484 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-280b0624-dbc8-4faa-a4e5-ff8524709223 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a41fbfb1db4c2c8bb0c9ef8020a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910b734a3aa343fb9c79c6f1ae1ed425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:31.338144 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-6c79272a-60b1-45b8-8559-f60b2edc5d47 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:31.338764 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-280b0624-dbc8-4faa-a4e5-ff8524709223 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] 10.222.0.35 "GET /compute/v2.1/servers/17932a8a-0c0c-4510-85ad-98dbf1a77bdc" status: 200 len: 1313 microversion: 2.1 time: 0.363263 Aug 07 04:56:31.338904 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-6c79272a-60b1-45b8-8559-f60b2edc5d47 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:31.339592 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 232/483] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:30 2021] GET /compute/v2.1/servers/17932a8a-0c0c-4510-85ad-98dbf1a77bdc => generated 1313 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:56:31.345412 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6c79272a-60b1-45b8-8559-f60b2edc5d47 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:31.345859 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6c79272a-60b1-45b8-8559-f60b2edc5d47 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:31.346633 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6c79272a-60b1-45b8-8559-f60b2edc5d47 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:31.347067 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6c79272a-60b1-45b8-8559-f60b2edc5d47 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:31.470279 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-6c79272a-60b1-45b8-8559-f60b2edc5d47 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:31.478468 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-6c79272a-60b1-45b8-8559-f60b2edc5d47 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5" status: 200 len: 1505 microversion: 2.1 time: 0.145520 Aug 07 04:56:31.479025 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 252/484] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:31 2021] GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5 => generated 1505 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:56:31.971030 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-21cef586-b7ee-4db6-9607-9b419861ddd5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:56:31.971985 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-21cef586-b7ee-4db6-9607-9b419861ddd5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:31.978359 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-21cef586-b7ee-4db6-9607-9b419861ddd5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:31.978804 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-21cef586-b7ee-4db6-9607-9b419861ddd5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:31.979570 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-21cef586-b7ee-4db6-9607-9b419861ddd5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:31.980001 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-21cef586-b7ee-4db6-9607-9b419861ddd5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:32.140320 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-21cef586-b7ee-4db6-9607-9b419861ddd5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 28634 microversion: 2.20 time: 0.172877 Aug 07 04:56:32.144210 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 233/485] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:56:31 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 28634 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:56:32.355653 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-1de95b89-ceda-49c0-8ed3-418426e60693 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:32.356263 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-1de95b89-ceda-49c0-8ed3-418426e60693 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] [instance: 17932a8a-0c0c-4510-85ad-98dbf1a77bdc] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:32.362533 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1de95b89-ceda-49c0-8ed3-418426e60693 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:32.362979 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1de95b89-ceda-49c0-8ed3-418426e60693 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:32.363743 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1de95b89-ceda-49c0-8ed3-418426e60693 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:32.364179 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1de95b89-ceda-49c0-8ed3-418426e60693 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:32.498001 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-1de95b89-ceda-49c0-8ed3-418426e60693 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a41fbfb1db4c2c8bb0c9ef8020a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910b734a3aa343fb9c79c6f1ae1ed425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:32.505672 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-1de95b89-ceda-49c0-8ed3-418426e60693 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] 10.222.0.35 "GET /compute/v2.1/servers/17932a8a-0c0c-4510-85ad-98dbf1a77bdc" status: 200 len: 1313 microversion: 2.1 time: 0.154215 Aug 07 04:56:32.506225 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 253/486] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:32 2021] GET /compute/v2.1/servers/17932a8a-0c0c-4510-85ad-98dbf1a77bdc => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:56:33.152398 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-79c0490f-f160-4a4b-9443-ba3b174d05b3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:56:33.153428 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-79c0490f-f160-4a4b-9443-ba3b174d05b3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:33.159816 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-79c0490f-f160-4a4b-9443-ba3b174d05b3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:33.160261 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-79c0490f-f160-4a4b-9443-ba3b174d05b3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:33.161046 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-79c0490f-f160-4a4b-9443-ba3b174d05b3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:33.161482 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-79c0490f-f160-4a4b-9443-ba3b174d05b3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:33.255991 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-79c0490f-f160-4a4b-9443-ba3b174d05b3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 28634 microversion: 2.20 time: 0.108044 Aug 07 04:56:33.256611 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 234/487] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:56:33 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 28634 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:56:33.522363 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-7ba55023-136b-4d43-ae56-d2810353c3e0 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:33.522977 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-7ba55023-136b-4d43-ae56-d2810353c3e0 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] [instance: 17932a8a-0c0c-4510-85ad-98dbf1a77bdc] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:33.529427 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-7ba55023-136b-4d43-ae56-d2810353c3e0 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:33.529878 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-7ba55023-136b-4d43-ae56-d2810353c3e0 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:33.530649 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-7ba55023-136b-4d43-ae56-d2810353c3e0 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:33.531087 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-7ba55023-136b-4d43-ae56-d2810353c3e0 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:33.652388 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-7ba55023-136b-4d43-ae56-d2810353c3e0 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a41fbfb1db4c2c8bb0c9ef8020a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910b734a3aa343fb9c79c6f1ae1ed425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:33.659707 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-7ba55023-136b-4d43-ae56-d2810353c3e0 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] 10.222.0.35 "GET /compute/v2.1/servers/17932a8a-0c0c-4510-85ad-98dbf1a77bdc" status: 200 len: 1496 microversion: 2.1 time: 0.140975 Aug 07 04:56:33.660266 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 254/488] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:33 2021] GET /compute/v2.1/servers/17932a8a-0c0c-4510-85ad-98dbf1a77bdc => generated 1496 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:56:33.848034 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-527be93b-fcfd-4b44-a34b-ddcd3714efe9 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b49638cc-9638-44a7-859d-46c68f382d99"}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:56:33.849248 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-527be93b-fcfd-4b44-a34b-ddcd3714efe9 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:33.855871 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-527be93b-fcfd-4b44-a34b-ddcd3714efe9 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:33.856322 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-527be93b-fcfd-4b44-a34b-ddcd3714efe9 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:33.857125 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-527be93b-fcfd-4b44-a34b-ddcd3714efe9 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:33.857564 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-527be93b-fcfd-4b44-a34b-ddcd3714efe9 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:34.121335 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-527be93b-fcfd-4b44-a34b-ddcd3714efe9 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "POST /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277190 Aug 07 04:56:34.122207 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 235/489] 10.222.0.35 () {60 vars in 1323 bytes} [Sat Aug 7 04:56:33 2021] POST /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:56:34.268059 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-9ce48fc5-ca83-456c-88c2-ee580ca0130f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:56:34.269005 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-9ce48fc5-ca83-456c-88c2-ee580ca0130f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:34.275401 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9ce48fc5-ca83-456c-88c2-ee580ca0130f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:34.275853 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9ce48fc5-ca83-456c-88c2-ee580ca0130f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:34.276622 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9ce48fc5-ca83-456c-88c2-ee580ca0130f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:34.277076 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9ce48fc5-ca83-456c-88c2-ee580ca0130f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:34.408685 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-9ce48fc5-ca83-456c-88c2-ee580ca0130f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 28634 microversion: 2.20 time: 0.143950 Aug 07 04:56:34.409524 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 255/490] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:56:34 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 28634 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:56:35.421924 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-30449a8c-28d5-448c-b02e-90de799e0269 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:56:35.422902 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-30449a8c-28d5-448c-b02e-90de799e0269 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:35.463685 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-ea0cdd3c-76e1-4ed0-87f5-806b8adc4d9f tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:35.464653 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-ea0cdd3c-76e1-4ed0-87f5-806b8adc4d9f tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] [instance: 17932a8a-0c0c-4510-85ad-98dbf1a77bdc] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:35.480748 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ea0cdd3c-76e1-4ed0-87f5-806b8adc4d9f tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:35.481410 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ea0cdd3c-76e1-4ed0-87f5-806b8adc4d9f tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:35.482189 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ea0cdd3c-76e1-4ed0-87f5-806b8adc4d9f tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:35.482618 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ea0cdd3c-76e1-4ed0-87f5-806b8adc4d9f tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:35.525376 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-ea0cdd3c-76e1-4ed0-87f5-806b8adc4d9f tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] [instance: 17932a8a-0c0c-4510-85ad-98dbf1a77bdc] Going to try to terminate instance {{(pid=107486) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 07 04:56:35.646767 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-ea0cdd3c-76e1-4ed0-87f5-806b8adc4d9f tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] 10.222.0.35 "DELETE /compute/v2.1/servers/17932a8a-0c0c-4510-85ad-98dbf1a77bdc" status: 204 len: 0 microversion: 2.1 time: 0.187678 Aug 07 04:56:35.648244 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 256/491] 10.222.0.35 () {58 vars in 1239 bytes} [Sat Aug 7 04:56:35 2021] DELETE /compute/v2.1/servers/17932a8a-0c0c-4510-85ad-98dbf1a77bdc => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 04:56:35.650464 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-30449a8c-28d5-448c-b02e-90de799e0269 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:35.650915 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-30449a8c-28d5-448c-b02e-90de799e0269 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:35.651707 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-30449a8c-28d5-448c-b02e-90de799e0269 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:35.652141 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-30449a8c-28d5-448c-b02e-90de799e0269 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:35.657767 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-dce98823-8014-4e7d-b788-4b066f3b221b tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:35.658718 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-dce98823-8014-4e7d-b788-4b066f3b221b tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] [instance: 17932a8a-0c0c-4510-85ad-98dbf1a77bdc] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:35.665926 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-dce98823-8014-4e7d-b788-4b066f3b221b tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:35.666605 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-dce98823-8014-4e7d-b788-4b066f3b221b tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:35.667827 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-dce98823-8014-4e7d-b788-4b066f3b221b tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:35.668446 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-dce98823-8014-4e7d-b788-4b066f3b221b tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:35.779682 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-30449a8c-28d5-448c-b02e-90de799e0269 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 28634 microversion: 2.20 time: 0.362241 Aug 07 04:56:35.781404 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 236/492] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:56:35 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 28634 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:56:35.806277 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-dce98823-8014-4e7d-b788-4b066f3b221b tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a41fbfb1db4c2c8bb0c9ef8020a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910b734a3aa343fb9c79c6f1ae1ed425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:35.814014 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-dce98823-8014-4e7d-b788-4b066f3b221b tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] 10.222.0.35 "GET /compute/v2.1/servers/17932a8a-0c0c-4510-85ad-98dbf1a77bdc" status: 200 len: 1502 microversion: 2.1 time: 0.160422 Aug 07 04:56:35.814582 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 257/493] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:35 2021] GET /compute/v2.1/servers/17932a8a-0c0c-4510-85ad-98dbf1a77bdc => generated 1502 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:56:36.407002 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-617ec8ba-b907-4ab5-9c45-973ba13d3fa5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:56:36.407931 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-617ec8ba-b907-4ab5-9c45-973ba13d3fa5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:36.414948 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-617ec8ba-b907-4ab5-9c45-973ba13d3fa5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:36.415410 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-617ec8ba-b907-4ab5-9c45-973ba13d3fa5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:36.416508 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-617ec8ba-b907-4ab5-9c45-973ba13d3fa5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:36.416979 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-617ec8ba-b907-4ab5-9c45-973ba13d3fa5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:36.439544 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.objects.instance [None req-617ec8ba-b907-4ab5-9c45-973ba13d3fa5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lazy-loading 'flavor' on Instance uuid 90d6eef5-1c82-472b-adfb-aeaa1e93d502 {{(pid=107485) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 04:56:36.608772 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-617ec8ba-b907-4ab5-9c45-973ba13d3fa5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "POST /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502/action" status: 200 len: 32 microversion: 2.1 time: 0.206027 Aug 07 04:56:36.609448 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 237/494] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 04:56:36 2021] POST /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502/action => generated 32 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 04:56:36.619413 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-23e27f81-c7ba-4a21-94e5-0725b0bf2cd2 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:36.620165 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-23e27f81-c7ba-4a21-94e5-0725b0bf2cd2 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:36.627325 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-23e27f81-c7ba-4a21-94e5-0725b0bf2cd2 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:36.627816 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-23e27f81-c7ba-4a21-94e5-0725b0bf2cd2 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:36.628947 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-23e27f81-c7ba-4a21-94e5-0725b0bf2cd2 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:36.629564 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-23e27f81-c7ba-4a21-94e5-0725b0bf2cd2 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:36.792860 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-5095760d-d86e-4e66-8d57-81735b326118 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:56:36.793914 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-5095760d-d86e-4e66-8d57-81735b326118 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:36.799969 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5095760d-d86e-4e66-8d57-81735b326118 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:36.800417 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5095760d-d86e-4e66-8d57-81735b326118 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:36.801224 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5095760d-d86e-4e66-8d57-81735b326118 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:36.801657 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5095760d-d86e-4e66-8d57-81735b326118 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:36.827243 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-23e27f81-c7ba-4a21-94e5-0725b0bf2cd2 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:36.835936 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-23e27f81-c7ba-4a21-94e5-0725b0bf2cd2 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1568 microversion: 2.1 time: 0.221019 Aug 07 04:56:36.836929 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 258/495] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:36 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1568 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:56:36.841678 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-bd580fe8-f9dd-4f43-9be2-a24de02093bc tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:36.842443 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-bd580fe8-f9dd-4f43-9be2-a24de02093bc tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] [instance: 17932a8a-0c0c-4510-85ad-98dbf1a77bdc] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:36.848131 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-bd580fe8-f9dd-4f43-9be2-a24de02093bc tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:36.848571 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-bd580fe8-f9dd-4f43-9be2-a24de02093bc tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:36.849401 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-bd580fe8-f9dd-4f43-9be2-a24de02093bc tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:36.849811 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-bd580fe8-f9dd-4f43-9be2-a24de02093bc tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:36.920261 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-5095760d-d86e-4e66-8d57-81735b326118 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 28634 microversion: 2.20 time: 0.132125 Aug 07 04:56:36.921782 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 238/496] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:56:36 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 28634 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 07 04:56:37.071135 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-bd580fe8-f9dd-4f43-9be2-a24de02093bc tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a41fbfb1db4c2c8bb0c9ef8020a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910b734a3aa343fb9c79c6f1ae1ed425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:37.078391 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-bd580fe8-f9dd-4f43-9be2-a24de02093bc tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] 10.222.0.35 "GET /compute/v2.1/servers/17932a8a-0c0c-4510-85ad-98dbf1a77bdc" status: 200 len: 1502 microversion: 2.1 time: 0.240427 Aug 07 04:56:37.088944 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 259/497] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:36 2021] GET /compute/v2.1/servers/17932a8a-0c0c-4510-85ad-98dbf1a77bdc => generated 1502 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:56:37.854447 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-45e31578-4b38-4bdc-ab63-b7b35c71d9d8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:37.855134 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-45e31578-4b38-4bdc-ab63-b7b35c71d9d8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:37.861460 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-45e31578-4b38-4bdc-ab63-b7b35c71d9d8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:37.861908 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-45e31578-4b38-4bdc-ab63-b7b35c71d9d8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:37.862671 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-45e31578-4b38-4bdc-ab63-b7b35c71d9d8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:37.863099 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-45e31578-4b38-4bdc-ab63-b7b35c71d9d8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:37.932539 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-5438ca6c-cb2d-4349-8e1f-db753b3251f9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:56:37.933701 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-5438ca6c-cb2d-4349-8e1f-db753b3251f9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:37.941079 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5438ca6c-cb2d-4349-8e1f-db753b3251f9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:37.941931 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5438ca6c-cb2d-4349-8e1f-db753b3251f9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:37.942828 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5438ca6c-cb2d-4349-8e1f-db753b3251f9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:37.943137 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5438ca6c-cb2d-4349-8e1f-db753b3251f9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:38.014956 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-45e31578-4b38-4bdc-ab63-b7b35c71d9d8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:38.032254 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-45e31578-4b38-4bdc-ab63-b7b35c71d9d8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1568 microversion: 2.1 time: 0.175415 Aug 07 04:56:38.032254 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 239/498] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:37 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:56:38.063259 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-5438ca6c-cb2d-4349-8e1f-db753b3251f9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 28634 microversion: 2.20 time: 0.135084 Aug 07 04:56:38.064866 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 260/499] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:56:37 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 28634 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 07 04:56:38.096549 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-a449fea7-c6ba-4403-8e7d-ee15c02f3bf9 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:38.097209 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-a449fea7-c6ba-4403-8e7d-ee15c02f3bf9 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] [instance: 17932a8a-0c0c-4510-85ad-98dbf1a77bdc] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:38.103600 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a449fea7-c6ba-4403-8e7d-ee15c02f3bf9 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:38.107517 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a449fea7-c6ba-4403-8e7d-ee15c02f3bf9 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:38.108126 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a449fea7-c6ba-4403-8e7d-ee15c02f3bf9 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:38.108819 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a449fea7-c6ba-4403-8e7d-ee15c02f3bf9 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:38.252589 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-a449fea7-c6ba-4403-8e7d-ee15c02f3bf9 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a41fbfb1db4c2c8bb0c9ef8020a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910b734a3aa343fb9c79c6f1ae1ed425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:38.260762 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-a449fea7-c6ba-4403-8e7d-ee15c02f3bf9 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] 10.222.0.35 "GET /compute/v2.1/servers/17932a8a-0c0c-4510-85ad-98dbf1a77bdc" status: 200 len: 1502 microversion: 2.1 time: 0.168321 Aug 07 04:56:38.261342 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 240/500] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:38 2021] GET /compute/v2.1/servers/17932a8a-0c0c-4510-85ad-98dbf1a77bdc => generated 1502 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:56:38.715082 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [req-273033c2-b613-451c-a09a-35691a5a0c9d req-08e85ba0-71b6-497c-a4d5-f088d5e8492a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17932a8a-0c0c-4510-85ad-98dbf1a77bdc", "name": "network-vif-deleted", "tag": "22b74cd5-b343-4ab5-9067-d22686f86c83"}]} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:56:38.717057 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 04:56:38.717057 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: warnings.warn(msg) Aug 07 04:56:38.728741 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-273033c2-b613-451c-a09a-35691a5a0c9d req-08e85ba0-71b6-497c-a4d5-f088d5e8492a service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:38.729696 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-273033c2-b613-451c-a09a-35691a5a0c9d req-08e85ba0-71b6-497c-a4d5-f088d5e8492a service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:38.743552 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.compute.server_external_events [req-273033c2-b613-451c-a09a-35691a5a0c9d req-08e85ba0-71b6-497c-a4d5-f088d5e8492a service nova] Creating event network-vif-deleted:22b74cd5-b343-4ab5-9067-d22686f86c83 for instance 17932a8a-0c0c-4510-85ad-98dbf1a77bdc on hv-cinder-80374 Aug 07 04:56:38.748694 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [req-273033c2-b613-451c-a09a-35691a5a0c9d req-08e85ba0-71b6-497c-a4d5-f088d5e8492a service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042736 Aug 07 04:56:38.749886 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 261/501] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 04:56:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:56:39.042054 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-e93d020d-1c51-46cd-925b-fe630380365d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:39.042694 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-e93d020d-1c51-46cd-925b-fe630380365d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:39.048992 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e93d020d-1c51-46cd-925b-fe630380365d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:39.049442 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e93d020d-1c51-46cd-925b-fe630380365d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:39.050218 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e93d020d-1c51-46cd-925b-fe630380365d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:39.050654 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e93d020d-1c51-46cd-925b-fe630380365d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:39.076238 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-48c10643-ef3b-4d0f-8dc4-809ee3a04608 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:56:39.077257 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-48c10643-ef3b-4d0f-8dc4-809ee3a04608 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:39.084658 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-48c10643-ef3b-4d0f-8dc4-809ee3a04608 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:39.085134 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-48c10643-ef3b-4d0f-8dc4-809ee3a04608 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:39.085903 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-48c10643-ef3b-4d0f-8dc4-809ee3a04608 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:39.086506 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-48c10643-ef3b-4d0f-8dc4-809ee3a04608 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:39.174540 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-e93d020d-1c51-46cd-925b-fe630380365d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:39.183648 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-e93d020d-1c51-46cd-925b-fe630380365d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1568 microversion: 2.1 time: 0.145520 Aug 07 04:56:39.184225 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 241/502] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:39 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:56:39.187088 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-48c10643-ef3b-4d0f-8dc4-809ee3a04608 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 28634 microversion: 2.20 time: 0.114969 Aug 07 04:56:39.187915 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 262/503] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:56:39 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 28634 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:56:39.282621 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-5170c501-1fbc-473f-8cee-b24a1912e989 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:39.283260 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-5170c501-1fbc-473f-8cee-b24a1912e989 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] [instance: 17932a8a-0c0c-4510-85ad-98dbf1a77bdc] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:39.289827 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5170c501-1fbc-473f-8cee-b24a1912e989 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:39.290277 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5170c501-1fbc-473f-8cee-b24a1912e989 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:39.291057 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5170c501-1fbc-473f-8cee-b24a1912e989 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:39.291506 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5170c501-1fbc-473f-8cee-b24a1912e989 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:39.331015 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5170c501-1fbc-473f-8cee-b24a1912e989 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:39.331648 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5170c501-1fbc-473f-8cee-b24a1912e989 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:39.332196 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.objects.instance [None req-5170c501-1fbc-473f-8cee-b24a1912e989 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lazy-loading 'fault' on Instance uuid 17932a8a-0c0c-4510-85ad-98dbf1a77bdc {{(pid=107485) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 04:56:39.373580 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-5170c501-1fbc-473f-8cee-b24a1912e989 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a41fbfb1db4c2c8bb0c9ef8020a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910b734a3aa343fb9c79c6f1ae1ed425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:39.380907 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-5170c501-1fbc-473f-8cee-b24a1912e989 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] 10.222.0.35 "GET /compute/v2.1/servers/17932a8a-0c0c-4510-85ad-98dbf1a77bdc" status: 200 len: 1303 microversion: 2.1 time: 0.101846 Aug 07 04:56:39.381721 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 242/504] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:39 2021] GET /compute/v2.1/servers/17932a8a-0c0c-4510-85ad-98dbf1a77bdc => generated 1303 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:56:40.199333 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-af49a39d-0ef7-4156-9c85-da50d8412cf9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:56:40.200349 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-af49a39d-0ef7-4156-9c85-da50d8412cf9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:40.200647 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-7edca99e-2658-4784-acf1-64429ad6f5ce tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:40.201301 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-7edca99e-2658-4784-acf1-64429ad6f5ce tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:40.206984 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7edca99e-2658-4784-acf1-64429ad6f5ce tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:40.207135 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-af49a39d-0ef7-4156-9c85-da50d8412cf9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:40.207427 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7edca99e-2658-4784-acf1-64429ad6f5ce tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:40.207544 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-af49a39d-0ef7-4156-9c85-da50d8412cf9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:40.208198 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7edca99e-2658-4784-acf1-64429ad6f5ce tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:40.208309 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-af49a39d-0ef7-4156-9c85-da50d8412cf9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:40.208634 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7edca99e-2658-4784-acf1-64429ad6f5ce tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:40.208745 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-af49a39d-0ef7-4156-9c85-da50d8412cf9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:40.310961 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-af49a39d-0ef7-4156-9c85-da50d8412cf9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 28634 microversion: 2.20 time: 0.116296 Aug 07 04:56:40.311617 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 263/505] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:56:40 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 28634 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:56:40.333156 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-7edca99e-2658-4784-acf1-64429ad6f5ce tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:40.341503 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-7edca99e-2658-4784-acf1-64429ad6f5ce tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1568 microversion: 2.1 time: 0.144590 Aug 07 04:56:40.342066 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 243/506] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:40 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:56:40.398974 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-292b826b-b978-4540-a641-05f9810cad63 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:40.399778 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-292b826b-b978-4540-a641-05f9810cad63 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] [instance: 17932a8a-0c0c-4510-85ad-98dbf1a77bdc] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:40.406254 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-292b826b-b978-4540-a641-05f9810cad63 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:40.406702 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-292b826b-b978-4540-a641-05f9810cad63 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:40.407472 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-292b826b-b978-4540-a641-05f9810cad63 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:40.407911 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-292b826b-b978-4540-a641-05f9810cad63 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:40.422372 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.wsgi [None req-292b826b-b978-4540-a641-05f9810cad63 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] HTTP exception thrown: Instance 17932a8a-0c0c-4510-85ad-98dbf1a77bdc could not be found. Aug 07 04:56:40.422960 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-292b826b-b978-4540-a641-05f9810cad63 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] Returning 404 to user: Instance 17932a8a-0c0c-4510-85ad-98dbf1a77bdc could not be found. {{(pid=107486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 07 04:56:40.423783 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-292b826b-b978-4540-a641-05f9810cad63 tempest-VolumesActionsTest-863742658 tempest-VolumesActionsTest-863742658-project] 10.222.0.35 "GET /compute/v2.1/servers/17932a8a-0c0c-4510-85ad-98dbf1a77bdc" status: 404 len: 111 microversion: 2.1 time: 0.029439 Aug 07 04:56:40.424309 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 264/507] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:40 2021] GET /compute/v2.1/servers/17932a8a-0c0c-4510-85ad-98dbf1a77bdc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 04:56:41.321994 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-06ac0356-0ad3-4c20-ae7d-6465e74eb827 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:56:41.322821 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-06ac0356-0ad3-4c20-ae7d-6465e74eb827 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:41.330046 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-06ac0356-0ad3-4c20-ae7d-6465e74eb827 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:41.330487 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-06ac0356-0ad3-4c20-ae7d-6465e74eb827 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:41.331251 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-06ac0356-0ad3-4c20-ae7d-6465e74eb827 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:41.331678 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-06ac0356-0ad3-4c20-ae7d-6465e74eb827 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:41.358218 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-55f94980-bef7-4d22-8cca-7f1f2aa170b2 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:41.358793 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-55f94980-bef7-4d22-8cca-7f1f2aa170b2 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:41.364609 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-55f94980-bef7-4d22-8cca-7f1f2aa170b2 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:41.365089 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-55f94980-bef7-4d22-8cca-7f1f2aa170b2 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:41.365857 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-55f94980-bef7-4d22-8cca-7f1f2aa170b2 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:41.366289 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-55f94980-bef7-4d22-8cca-7f1f2aa170b2 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:41.424460 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-06ac0356-0ad3-4c20-ae7d-6465e74eb827 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 28634 microversion: 2.20 time: 0.105993 Aug 07 04:56:41.428409 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 244/508] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:56:41 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 28634 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:56:41.494614 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-55f94980-bef7-4d22-8cca-7f1f2aa170b2 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:41.502578 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-55f94980-bef7-4d22-8cca-7f1f2aa170b2 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1568 microversion: 2.1 time: 0.147943 Aug 07 04:56:41.503590 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 265/509] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:41 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:56:42.436822 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-a93c5260-048a-41a8-aa29-ce33829cd379 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:56:42.437740 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-a93c5260-048a-41a8-aa29-ce33829cd379 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:42.444531 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a93c5260-048a-41a8-aa29-ce33829cd379 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:42.445522 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a93c5260-048a-41a8-aa29-ce33829cd379 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:42.446623 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a93c5260-048a-41a8-aa29-ce33829cd379 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:42.447065 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a93c5260-048a-41a8-aa29-ce33829cd379 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:42.520468 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-6c9a350c-209c-44cb-9597-01d57c196656 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:42.521104 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-6c9a350c-209c-44cb-9597-01d57c196656 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:42.527976 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6c9a350c-209c-44cb-9597-01d57c196656 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:42.528428 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6c9a350c-209c-44cb-9597-01d57c196656 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:42.529417 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6c9a350c-209c-44cb-9597-01d57c196656 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:42.529853 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6c9a350c-209c-44cb-9597-01d57c196656 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:42.659721 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-6c9a350c-209c-44cb-9597-01d57c196656 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:42.667459 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-6c9a350c-209c-44cb-9597-01d57c196656 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1568 microversion: 2.1 time: 0.150660 Aug 07 04:56:42.668012 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 266/510] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:42 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:56:43.683135 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-cd7cd02a-dd24-4361-bba5-c91fa881d8e4 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:43.683805 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-cd7cd02a-dd24-4361-bba5-c91fa881d8e4 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:43.689800 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-cd7cd02a-dd24-4361-bba5-c91fa881d8e4 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:43.690243 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-cd7cd02a-dd24-4361-bba5-c91fa881d8e4 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:43.691001 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-cd7cd02a-dd24-4361-bba5-c91fa881d8e4 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:43.691434 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-cd7cd02a-dd24-4361-bba5-c91fa881d8e4 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:43.810127 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-cd7cd02a-dd24-4361-bba5-c91fa881d8e4 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:43.817919 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-cd7cd02a-dd24-4361-bba5-c91fa881d8e4 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1568 microversion: 2.1 time: 0.138431 Aug 07 04:56:43.818482 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 267/511] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:43 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:56:44.835288 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-5394aa39-c55f-433f-9ec9-229226fb0944 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:44.835952 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-5394aa39-c55f-433f-9ec9-229226fb0944 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:44.841967 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5394aa39-c55f-433f-9ec9-229226fb0944 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:44.842406 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5394aa39-c55f-433f-9ec9-229226fb0944 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:44.843163 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5394aa39-c55f-433f-9ec9-229226fb0944 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:44.843595 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5394aa39-c55f-433f-9ec9-229226fb0944 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:44.966767 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-5394aa39-c55f-433f-9ec9-229226fb0944 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:44.974578 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-5394aa39-c55f-433f-9ec9-229226fb0944 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1568 microversion: 2.1 time: 0.143113 Aug 07 04:56:44.975135 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 268/512] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:44 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1568 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:56:45.991830 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-d29e4c11-0687-4d8c-b7ff-d2a502b51441 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:45.992994 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-d29e4c11-0687-4d8c-b7ff-d2a502b51441 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:45.998871 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d29e4c11-0687-4d8c-b7ff-d2a502b51441 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:45.999346 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d29e4c11-0687-4d8c-b7ff-d2a502b51441 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:46.000107 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d29e4c11-0687-4d8c-b7ff-d2a502b51441 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:46.000538 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d29e4c11-0687-4d8c-b7ff-d2a502b51441 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:46.124707 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-d29e4c11-0687-4d8c-b7ff-d2a502b51441 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:46.132491 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-d29e4c11-0687-4d8c-b7ff-d2a502b51441 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1568 microversion: 2.1 time: 0.144377 Aug 07 04:56:46.133119 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 269/513] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:45 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:56:46.761171 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-a93c5260-048a-41a8-aa29-ce33829cd379 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 28634 microversion: 2.20 time: 4.328272 Aug 07 04:56:46.765379 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 245/514] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:56:42 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 28634 bytes in 4330 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 07 04:56:47.149619 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-f240262b-b518-43ed-b6f6-c97cbfddf410 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:47.150247 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-f240262b-b518-43ed-b6f6-c97cbfddf410 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:47.156098 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f240262b-b518-43ed-b6f6-c97cbfddf410 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:47.156534 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f240262b-b518-43ed-b6f6-c97cbfddf410 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:47.157311 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f240262b-b518-43ed-b6f6-c97cbfddf410 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:47.157739 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f240262b-b518-43ed-b6f6-c97cbfddf410 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:47.278585 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-f240262b-b518-43ed-b6f6-c97cbfddf410 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:47.286430 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-f240262b-b518-43ed-b6f6-c97cbfddf410 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1568 microversion: 2.1 time: 0.140958 Aug 07 04:56:47.286981 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 270/515] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:47 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:56:47.773129 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-46a7a0f2-ec29-45fb-870f-0085dc8f9868 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:56:47.774809 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-46a7a0f2-ec29-45fb-870f-0085dc8f9868 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:47.781431 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-46a7a0f2-ec29-45fb-870f-0085dc8f9868 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:47.781882 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-46a7a0f2-ec29-45fb-870f-0085dc8f9868 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:47.783946 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-46a7a0f2-ec29-45fb-870f-0085dc8f9868 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:47.784386 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-46a7a0f2-ec29-45fb-870f-0085dc8f9868 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:48.304505 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-4ac030b3-8604-495a-a7a4-2028b702c96a tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:48.305579 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-4ac030b3-8604-495a-a7a4-2028b702c96a tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:48.311861 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4ac030b3-8604-495a-a7a4-2028b702c96a tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:48.312308 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4ac030b3-8604-495a-a7a4-2028b702c96a tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:48.313105 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4ac030b3-8604-495a-a7a4-2028b702c96a tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:48.313577 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4ac030b3-8604-495a-a7a4-2028b702c96a tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:48.442610 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-4ac030b3-8604-495a-a7a4-2028b702c96a tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:48.452306 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-4ac030b3-8604-495a-a7a4-2028b702c96a tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1568 microversion: 2.1 time: 0.151438 Aug 07 04:56:48.452892 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 271/516] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:48 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:56:49.469670 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-778f28c5-c5da-42b8-a9d6-e3431968ca6a tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:49.470320 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-778f28c5-c5da-42b8-a9d6-e3431968ca6a tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:49.476013 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-778f28c5-c5da-42b8-a9d6-e3431968ca6a tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:49.477271 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-778f28c5-c5da-42b8-a9d6-e3431968ca6a tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:49.478486 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-778f28c5-c5da-42b8-a9d6-e3431968ca6a tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:49.478925 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-778f28c5-c5da-42b8-a9d6-e3431968ca6a tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:49.602907 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-778f28c5-c5da-42b8-a9d6-e3431968ca6a tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:49.610802 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-778f28c5-c5da-42b8-a9d6-e3431968ca6a tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1568 microversion: 2.1 time: 0.144908 Aug 07 04:56:49.611366 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 272/517] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:49 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:56:50.627914 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-4befdb66-ac74-4d66-a65a-4405aae98437 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:50.628524 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-4befdb66-ac74-4d66-a65a-4405aae98437 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:50.635011 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4befdb66-ac74-4d66-a65a-4405aae98437 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:50.635454 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4befdb66-ac74-4d66-a65a-4405aae98437 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:50.636223 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4befdb66-ac74-4d66-a65a-4405aae98437 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:50.636656 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4befdb66-ac74-4d66-a65a-4405aae98437 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:50.754727 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-4befdb66-ac74-4d66-a65a-4405aae98437 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:50.764744 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-4befdb66-ac74-4d66-a65a-4405aae98437 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1568 microversion: 2.1 time: 0.140499 Aug 07 04:56:50.765431 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 273/518] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:50 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:56:51.783230 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-6119d6bf-9ae4-4021-8e7e-6053230f84a2 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:51.783826 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-6119d6bf-9ae4-4021-8e7e-6053230f84a2 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:51.790561 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6119d6bf-9ae4-4021-8e7e-6053230f84a2 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:51.791004 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6119d6bf-9ae4-4021-8e7e-6053230f84a2 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:51.791766 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6119d6bf-9ae4-4021-8e7e-6053230f84a2 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:51.792200 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6119d6bf-9ae4-4021-8e7e-6053230f84a2 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:51.910550 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-6119d6bf-9ae4-4021-8e7e-6053230f84a2 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:51.918266 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-6119d6bf-9ae4-4021-8e7e-6053230f84a2 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1568 microversion: 2.1 time: 0.138752 Aug 07 04:56:51.918852 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 274/519] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:51 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:56:52.855758 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-46a7a0f2-ec29-45fb-870f-0085dc8f9868 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 28634 microversion: 2.20 time: 5.086581 Aug 07 04:56:52.857088 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 246/520] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:56:47 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 28634 bytes in 5089 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 07 04:56:52.935614 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-b4fb0818-14e9-46b2-960d-daaca75d9399 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:52.936126 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-b4fb0818-14e9-46b2-960d-daaca75d9399 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:52.941969 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b4fb0818-14e9-46b2-960d-daaca75d9399 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:52.942414 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b4fb0818-14e9-46b2-960d-daaca75d9399 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:52.943177 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b4fb0818-14e9-46b2-960d-daaca75d9399 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:52.943605 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b4fb0818-14e9-46b2-960d-daaca75d9399 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:53.264610 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-b4fb0818-14e9-46b2-960d-daaca75d9399 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:53.272289 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-b4fb0818-14e9-46b2-960d-daaca75d9399 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1568 microversion: 2.1 time: 0.340561 Aug 07 04:56:53.272874 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 275/521] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:52 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1568 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:56:53.869553 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-f0a70233-8f93-421f-a9e3-35cc27bec0a9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:56:53.870541 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-f0a70233-8f93-421f-a9e3-35cc27bec0a9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:53.877029 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f0a70233-8f93-421f-a9e3-35cc27bec0a9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:53.877472 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f0a70233-8f93-421f-a9e3-35cc27bec0a9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:53.878232 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f0a70233-8f93-421f-a9e3-35cc27bec0a9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:53.878662 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f0a70233-8f93-421f-a9e3-35cc27bec0a9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:54.133681 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-f0a70233-8f93-421f-a9e3-35cc27bec0a9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 28634 microversion: 2.20 time: 0.269167 Aug 07 04:56:54.136269 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 247/522] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:56:53 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 28634 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:56:54.290870 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-f7be2c95-98f5-4b74-b084-e2c008be1034 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:54.292219 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-f7be2c95-98f5-4b74-b084-e2c008be1034 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:54.298224 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f7be2c95-98f5-4b74-b084-e2c008be1034 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:54.298664 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f7be2c95-98f5-4b74-b084-e2c008be1034 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:54.299429 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f7be2c95-98f5-4b74-b084-e2c008be1034 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:54.299856 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f7be2c95-98f5-4b74-b084-e2c008be1034 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:54.428190 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-f7be2c95-98f5-4b74-b084-e2c008be1034 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:54.436948 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-f7be2c95-98f5-4b74-b084-e2c008be1034 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1568 microversion: 2.1 time: 0.150874 Aug 07 04:56:54.437536 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 276/523] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:54 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:56:55.145551 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-94254178-9871-4a8d-afa8-7f3479d8122a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:56:55.146546 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-94254178-9871-4a8d-afa8-7f3479d8122a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:55.153143 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-94254178-9871-4a8d-afa8-7f3479d8122a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:55.153587 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-94254178-9871-4a8d-afa8-7f3479d8122a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:55.154346 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-94254178-9871-4a8d-afa8-7f3479d8122a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:55.154775 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-94254178-9871-4a8d-afa8-7f3479d8122a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:55.351230 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-7748b8f1-f3e3-4321-a579-217d09628f38 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b49638cc-9638-44a7-859d-46c68f382d99"}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:56:55.352866 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-7748b8f1-f3e3-4321-a579-217d09628f38 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:55.358645 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-7748b8f1-f3e3-4321-a579-217d09628f38 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:55.359094 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-7748b8f1-f3e3-4321-a579-217d09628f38 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:55.359860 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-7748b8f1-f3e3-4321-a579-217d09628f38 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:55.360293 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-7748b8f1-f3e3-4321-a579-217d09628f38 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:55.440738 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.wsgi [None req-7748b8f1-f3e3-4321-a579-217d09628f38 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] HTTP exception thrown: Invalid volume: volume b49638cc-9638-44a7-859d-46c68f382d99 is already attached to instances: 5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5 Aug 07 04:56:55.441361 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-7748b8f1-f3e3-4321-a579-217d09628f38 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Returning 400 to user: Invalid volume: volume b49638cc-9638-44a7-859d-46c68f382d99 is already attached to instances: 5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5 {{(pid=107486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 07 04:56:55.442217 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-7748b8f1-f3e3-4321-a579-217d09628f38 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "POST /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094979 Aug 07 04:56:55.442759 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 277/524] 10.222.0.35 () {60 vars in 1323 bytes} [Sat Aug 7 04:56:55 2021] POST /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5/os-volume_attachments => generated 174 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 07 04:56:55.453069 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-8f525e48-8680-4c65-a67c-b9fd21e5e95d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:55.453678 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-8f525e48-8680-4c65-a67c-b9fd21e5e95d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:55.459355 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8f525e48-8680-4c65-a67c-b9fd21e5e95d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:55.459794 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8f525e48-8680-4c65-a67c-b9fd21e5e95d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:55.460562 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8f525e48-8680-4c65-a67c-b9fd21e5e95d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:55.461536 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8f525e48-8680-4c65-a67c-b9fd21e5e95d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:55.582241 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-8f525e48-8680-4c65-a67c-b9fd21e5e95d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:55.591627 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-8f525e48-8680-4c65-a67c-b9fd21e5e95d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1568 microversion: 2.1 time: 0.142012 Aug 07 04:56:55.592180 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 278/525] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:55 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:56:55.596742 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-6ba05e17-28f2-40fa-8798-bb9cbc0d33b6 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:55.597374 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-6ba05e17-28f2-40fa-8798-bb9cbc0d33b6 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:55.603933 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6ba05e17-28f2-40fa-8798-bb9cbc0d33b6 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:55.604380 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6ba05e17-28f2-40fa-8798-bb9cbc0d33b6 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:55.605212 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6ba05e17-28f2-40fa-8798-bb9cbc0d33b6 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:55.605658 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6ba05e17-28f2-40fa-8798-bb9cbc0d33b6 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:55.688099 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.objects.instance [None req-6ba05e17-28f2-40fa-8798-bb9cbc0d33b6 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lazy-loading 'services' on Instance uuid 5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5 {{(pid=107486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 04:56:55.752611 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-6ba05e17-28f2-40fa-8798-bb9cbc0d33b6 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "DELETE /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5/os-volume_attachments/b49638cc-9638-44a7-859d-46c68f382d99" status: 202 len: 0 microversion: 2.1 time: 0.159252 Aug 07 04:56:55.753231 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 279/526] 10.222.0.35 () {58 vars in 1416 bytes} [Sat Aug 7 04:56:55 2021] DELETE /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5/os-volume_attachments/b49638cc-9638-44a7-859d-46c68f382d99 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:56:55.762080 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-b40cfe81-b0c4-4de8-a233-f17bce09d2be tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:55.763121 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-b40cfe81-b0c4-4de8-a233-f17bce09d2be tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:55.769152 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b40cfe81-b0c4-4de8-a233-f17bce09d2be tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:55.769602 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b40cfe81-b0c4-4de8-a233-f17bce09d2be tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:55.770443 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b40cfe81-b0c4-4de8-a233-f17bce09d2be tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:55.770878 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b40cfe81-b0c4-4de8-a233-f17bce09d2be tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:55.805184 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-b40cfe81-b0c4-4de8-a233-f17bce09d2be tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047239 Aug 07 04:56:55.805748 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 280/527] 10.222.0.35 () {58 vars in 1302 bytes} [Sat Aug 7 04:56:55 2021] GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 04:56:56.607569 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-8a3c9fe2-9901-4045-ac36-d780f7122e47 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:56.608029 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-8a3c9fe2-9901-4045-ac36-d780f7122e47 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:56.614078 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8a3c9fe2-9901-4045-ac36-d780f7122e47 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:56.614521 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8a3c9fe2-9901-4045-ac36-d780f7122e47 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:56.615288 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8a3c9fe2-9901-4045-ac36-d780f7122e47 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:56.615772 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8a3c9fe2-9901-4045-ac36-d780f7122e47 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:56.743043 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-8a3c9fe2-9901-4045-ac36-d780f7122e47 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:56.750695 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-8a3c9fe2-9901-4045-ac36-d780f7122e47 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1568 microversion: 2.1 time: 0.147038 Aug 07 04:56:56.751256 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 281/528] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:56 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:56:56.816020 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-96493e9a-2dfb-422b-b299-50cfa50ea7a2 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:56.816956 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-96493e9a-2dfb-422b-b299-50cfa50ea7a2 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:56.823305 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-96493e9a-2dfb-422b-b299-50cfa50ea7a2 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:56.823746 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-96493e9a-2dfb-422b-b299-50cfa50ea7a2 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:56.824498 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-96493e9a-2dfb-422b-b299-50cfa50ea7a2 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:56.824952 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-96493e9a-2dfb-422b-b299-50cfa50ea7a2 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:56.853769 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-96493e9a-2dfb-422b-b299-50cfa50ea7a2 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041114 Aug 07 04:56:56.854305 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 282/529] 10.222.0.35 () {58 vars in 1302 bytes} [Sat Aug 7 04:56:56 2021] GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 04:56:57.768050 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-0ebc7646-3153-4b2c-891c-4e1b9081f3cf tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:57.768689 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-0ebc7646-3153-4b2c-891c-4e1b9081f3cf tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:57.775268 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0ebc7646-3153-4b2c-891c-4e1b9081f3cf tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:57.775709 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0ebc7646-3153-4b2c-891c-4e1b9081f3cf tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:57.776475 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0ebc7646-3153-4b2c-891c-4e1b9081f3cf tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:57.776939 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0ebc7646-3153-4b2c-891c-4e1b9081f3cf tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:57.895241 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-0ebc7646-3153-4b2c-891c-4e1b9081f3cf tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:57.903761 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-0ebc7646-3153-4b2c-891c-4e1b9081f3cf tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1568 microversion: 2.1 time: 0.139353 Aug 07 04:56:57.904314 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 283/530] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:57 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:56:57.908563 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-2dc89232-6146-406c-94ed-5091111ccc29 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:57.909469 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-2dc89232-6146-406c-94ed-5091111ccc29 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:57.915138 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2dc89232-6146-406c-94ed-5091111ccc29 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:57.915580 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2dc89232-6146-406c-94ed-5091111ccc29 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:57.916374 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2dc89232-6146-406c-94ed-5091111ccc29 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:57.916810 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2dc89232-6146-406c-94ed-5091111ccc29 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:57.946590 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-2dc89232-6146-406c-94ed-5091111ccc29 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041179 Aug 07 04:56:57.947136 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 284/531] 10.222.0.35 () {58 vars in 1302 bytes} [Sat Aug 7 04:56:57 2021] GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:56:58.920401 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-cc9f40d8-7ede-49fb-b20d-1345163d58d6 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:58.921049 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-cc9f40d8-7ede-49fb-b20d-1345163d58d6 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:58.926812 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-cc9f40d8-7ede-49fb-b20d-1345163d58d6 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:58.927252 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-cc9f40d8-7ede-49fb-b20d-1345163d58d6 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:58.928100 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-cc9f40d8-7ede-49fb-b20d-1345163d58d6 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:58.928532 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-cc9f40d8-7ede-49fb-b20d-1345163d58d6 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:59.047585 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-cc9f40d8-7ede-49fb-b20d-1345163d58d6 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:56:59.055304 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-cc9f40d8-7ede-49fb-b20d-1345163d58d6 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1568 microversion: 2.1 time: 0.138638 Aug 07 04:56:59.056374 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 285/532] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:56:58 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:56:59.060733 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-1d9245d2-bc03-42c3-b79e-3f50403742f5 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:56:59.061653 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-1d9245d2-bc03-42c3-b79e-3f50403742f5 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:56:59.067017 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1d9245d2-bc03-42c3-b79e-3f50403742f5 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:59.067462 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1d9245d2-bc03-42c3-b79e-3f50403742f5 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:59.068259 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1d9245d2-bc03-42c3-b79e-3f50403742f5 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:56:59.068691 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1d9245d2-bc03-42c3-b79e-3f50403742f5 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:56:59.097823 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-1d9245d2-bc03-42c3-b79e-3f50403742f5 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040452 Aug 07 04:56:59.098358 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 286/533] 10.222.0.35 () {58 vars in 1302 bytes} [Sat Aug 7 04:56:59 2021] GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:56:59.236903 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-94254178-9871-4a8d-afa8-7f3479d8122a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 28634 microversion: 2.20 time: 4.095062 Aug 07 04:56:59.237565 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 248/534] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:56:55 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 28634 bytes in 4097 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:57:00.074037 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-18c57958-2153-40a7-ab1f-3e2cec943953 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:00.074677 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-18c57958-2153-40a7-ab1f-3e2cec943953 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:00.080711 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-18c57958-2153-40a7-ab1f-3e2cec943953 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:00.081194 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-18c57958-2153-40a7-ab1f-3e2cec943953 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:00.082492 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-18c57958-2153-40a7-ab1f-3e2cec943953 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:00.082925 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-18c57958-2153-40a7-ab1f-3e2cec943953 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:00.110278 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-8cc10081-b0e5-4658-823f-f1a2058ebc68 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:00.111267 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-8cc10081-b0e5-4658-823f-f1a2058ebc68 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:00.117811 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8cc10081-b0e5-4658-823f-f1a2058ebc68 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:00.118252 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8cc10081-b0e5-4658-823f-f1a2058ebc68 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:00.119018 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8cc10081-b0e5-4658-823f-f1a2058ebc68 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:00.119638 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8cc10081-b0e5-4658-823f-f1a2058ebc68 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:00.149227 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-8cc10081-b0e5-4658-823f-f1a2058ebc68 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043018 Aug 07 04:57:00.150198 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 249/535] 10.222.0.35 () {58 vars in 1302 bytes} [Sat Aug 7 04:57:00 2021] GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:57:00.247573 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-a330e1f7-71c2-42c6-ba8c-e2840542defe tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:57:00.248472 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-a330e1f7-71c2-42c6-ba8c-e2840542defe tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:00.254701 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a330e1f7-71c2-42c6-ba8c-e2840542defe tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:00.255207 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a330e1f7-71c2-42c6-ba8c-e2840542defe tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:00.256130 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a330e1f7-71c2-42c6-ba8c-e2840542defe tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:00.256608 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a330e1f7-71c2-42c6-ba8c-e2840542defe tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:00.299306 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-18c57958-2153-40a7-ab1f-3e2cec943953 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:00.307255 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-18c57958-2153-40a7-ab1f-3e2cec943953 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1568 microversion: 2.1 time: 0.236748 Aug 07 04:57:00.307769 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 287/536] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:00 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1568 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:00.407285 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-a330e1f7-71c2-42c6-ba8c-e2840542defe tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 28634 microversion: 2.20 time: 0.163341 Aug 07 04:57:00.411185 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 250/537] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:57:00 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 28634 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 07 04:57:01.160590 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-41c0e613-8d30-48fa-9f14-166e463fb0dd tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:01.161456 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-41c0e613-8d30-48fa-9f14-166e463fb0dd tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:01.167788 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-41c0e613-8d30-48fa-9f14-166e463fb0dd tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:01.168233 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-41c0e613-8d30-48fa-9f14-166e463fb0dd tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:01.169035 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-41c0e613-8d30-48fa-9f14-166e463fb0dd tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:01.169466 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-41c0e613-8d30-48fa-9f14-166e463fb0dd tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:01.198577 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-41c0e613-8d30-48fa-9f14-166e463fb0dd tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041756 Aug 07 04:57:01.199139 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 288/538] 10.222.0.35 () {58 vars in 1302 bytes} [Sat Aug 7 04:57:01 2021] GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:57:01.323751 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-d86eccb3-9cb9-437c-84cf-a685167f3cf4 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:01.324437 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-d86eccb3-9cb9-437c-84cf-a685167f3cf4 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:01.330820 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d86eccb3-9cb9-437c-84cf-a685167f3cf4 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:01.331262 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d86eccb3-9cb9-437c-84cf-a685167f3cf4 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:01.332017 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d86eccb3-9cb9-437c-84cf-a685167f3cf4 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:01.332445 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d86eccb3-9cb9-437c-84cf-a685167f3cf4 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:01.418872 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-6c0108f8-508d-4ac2-ac45-f7b801ece68e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:57:01.419827 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-6c0108f8-508d-4ac2-ac45-f7b801ece68e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:01.426316 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6c0108f8-508d-4ac2-ac45-f7b801ece68e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:01.426764 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6c0108f8-508d-4ac2-ac45-f7b801ece68e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:01.427541 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6c0108f8-508d-4ac2-ac45-f7b801ece68e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:01.427975 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6c0108f8-508d-4ac2-ac45-f7b801ece68e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:01.460039 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-d86eccb3-9cb9-437c-84cf-a685167f3cf4 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:01.469134 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-d86eccb3-9cb9-437c-84cf-a685167f3cf4 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1568 microversion: 2.1 time: 0.149337 Aug 07 04:57:01.469970 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 251/539] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:01 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:01.562144 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-6c0108f8-508d-4ac2-ac45-f7b801ece68e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 28634 microversion: 2.20 time: 0.147411 Aug 07 04:57:01.562810 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 289/540] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:57:01 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 28634 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 07 04:57:02.209876 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-5091f853-4332-4dde-b1df-7e2600741830 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:02.210811 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-5091f853-4332-4dde-b1df-7e2600741830 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:02.217000 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5091f853-4332-4dde-b1df-7e2600741830 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:02.217449 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5091f853-4332-4dde-b1df-7e2600741830 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:02.218224 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5091f853-4332-4dde-b1df-7e2600741830 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:02.218653 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5091f853-4332-4dde-b1df-7e2600741830 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:02.251375 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-5091f853-4332-4dde-b1df-7e2600741830 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045344 Aug 07 04:57:02.251931 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 252/541] 10.222.0.35 () {58 vars in 1302 bytes} [Sat Aug 7 04:57:02 2021] GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 04:57:02.427917 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-a8afd0c2-bcc6-42bb-93e9-03d2846c9ff2 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-610149164", "imageRef": "ddcf95b5-3ea4-4a61-8f54-4b2feadb8682", "flavorRef": "452", "networks": [{"uuid": "c0e4a04f-a799-47ad-9475-bb3ebbb61692"}]}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:57:02.484196 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.network.neutron [None req-a8afd0c2-bcc6-42bb-93e9-03d2846c9ff2 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] validate_networks() for [('c0e4a04f-a799-47ad-9475-bb3ebbb61692', None, None, None)] {{(pid=107486) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 07 04:57:02.485747 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-8d6a06d5-c0ea-46b1-bd3d-2c85d2deb152 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:02.486443 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-8d6a06d5-c0ea-46b1-bd3d-2c85d2deb152 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:02.499880 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8d6a06d5-c0ea-46b1-bd3d-2c85d2deb152 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:02.501014 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8d6a06d5-c0ea-46b1-bd3d-2c85d2deb152 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:02.501901 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8d6a06d5-c0ea-46b1-bd3d-2c85d2deb152 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:02.502554 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8d6a06d5-c0ea-46b1-bd3d-2c85d2deb152 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:02.758389 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-8d6a06d5-c0ea-46b1-bd3d-2c85d2deb152 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:02.783871 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-8d6a06d5-c0ea-46b1-bd3d-2c85d2deb152 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1568 microversion: 2.1 time: 0.301623 Aug 07 04:57:02.794830 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 253/542] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:02 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1568 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:57:02.812272 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-fd8c9f9b-0edf-4ff3-8a2d-6db99863bb27 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:57:02.814306 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-fd8c9f9b-0edf-4ff3-8a2d-6db99863bb27 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:02.821675 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-fd8c9f9b-0edf-4ff3-8a2d-6db99863bb27 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:02.822605 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-fd8c9f9b-0edf-4ff3-8a2d-6db99863bb27 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:02.824402 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-fd8c9f9b-0edf-4ff3-8a2d-6db99863bb27 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:02.827786 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-fd8c9f9b-0edf-4ff3-8a2d-6db99863bb27 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:02.957915 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-fd8c9f9b-0edf-4ff3-8a2d-6db99863bb27 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 28634 microversion: 2.20 time: 0.160910 Aug 07 04:57:02.959192 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 254/543] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:57:02 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 28634 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:57:03.100575 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.virt.hardware [None req-a8afd0c2-bcc6-42bb-93e9-03d2846c9ff2 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Flavor limits 0:0:0 {{(pid=107486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 04:57:03.101222 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.virt.hardware [None req-a8afd0c2-bcc6-42bb-93e9-03d2846c9ff2 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Image limits 0:0:0 {{(pid=107486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 04:57:03.102102 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.virt.hardware [None req-a8afd0c2-bcc6-42bb-93e9-03d2846c9ff2 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Flavor pref 0:0:0 {{(pid=107486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 04:57:03.103422 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.virt.hardware [None req-a8afd0c2-bcc6-42bb-93e9-03d2846c9ff2 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Image pref 0:0:0 {{(pid=107486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 04:57:03.105278 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.virt.hardware [None req-a8afd0c2-bcc6-42bb-93e9-03d2846c9ff2 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 04:57:03.146764 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a8afd0c2-bcc6-42bb-93e9-03d2846c9ff2 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:03.147218 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a8afd0c2-bcc6-42bb-93e9-03d2846c9ff2 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:03.149794 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a8afd0c2-bcc6-42bb-93e9-03d2846c9ff2 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:03.152714 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a8afd0c2-bcc6-42bb-93e9-03d2846c9ff2 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:03.194002 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.quota [None req-a8afd0c2-bcc6-42bb-93e9-03d2846c9ff2 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Getting quotas for project 56d51e070d184693b32f62e300ded4fa. Resources: {'ram', 'cores', 'instances'} {{(pid=107486) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 07 04:57:03.207203 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.quota [None req-a8afd0c2-bcc6-42bb-93e9-03d2846c9ff2 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Getting quotas for user d1a3194159fb47cdb59335fc442ad6dc and project 56d51e070d184693b32f62e300ded4fa. Resources: {'ram', 'cores', 'instances'} {{(pid=107486) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 07 04:57:03.231701 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-a8afd0c2-bcc6-42bb-93e9-03d2846c9ff2 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Going to run 1 instances... {{(pid=107486) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 07 04:57:03.243722 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-a8afd0c2-bcc6-42bb-93e9-03d2846c9ff2 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 4b54c939-5f03-4579-bb04-d01e73617541] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ddcf95b5-3ea4-4a61-8f54-4b2feadb8682',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107486) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 07 04:57:03.277627 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-7d01caec-dc54-4d40-87d5-c02432982ad4 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-762052664", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1125723205", "security_groups": [{"name": "tempest-secgroup-smoke-428334738"}], "block_device_mapping_v2": [{"uuid": "c286e5e7-2a31-4ff3-875e-19ecb44e9a5c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b97eba61-232f-41ac-a37d-dd36ec699f72"}]}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:57:03.352531 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-a8afd0c2-bcc6-42bb-93e9-03d2846c9ff2 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.932694 Aug 07 04:57:03.359676 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 290/544] 10.222.0.35 () {60 vars in 1147 bytes} [Sat Aug 7 04:57:02 2021] POST /compute/v2.1/servers => generated 380 bytes in 943 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 04:57:03.364775 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-454cffff-ff8e-4b2a-a776-2dbb668ad6dc tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:03.365419 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-454cffff-ff8e-4b2a-a776-2dbb668ad6dc tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 4b54c939-5f03-4579-bb04-d01e73617541] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:03.496237 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.network.neutron [None req-7d01caec-dc54-4d40-87d5-c02432982ad4 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] validate_networks() for [('b97eba61-232f-41ac-a37d-dd36ec699f72', None, None, None)] {{(pid=107485) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 07 04:57:03.508862 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-454cffff-ff8e-4b2a-a776-2dbb668ad6dc tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:03.525149 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-454cffff-ff8e-4b2a-a776-2dbb668ad6dc tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541" status: 200 len: 1217 microversion: 2.1 time: 0.164508 Aug 07 04:57:03.531808 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 291/545] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:03 2021] GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541 => generated 1217 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:03.804142 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-b4140490-4810-4f73-9232-e17af2d53605 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:03.804929 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-b4140490-4810-4f73-9232-e17af2d53605 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:03.814605 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b4140490-4810-4f73-9232-e17af2d53605 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:03.818130 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b4140490-4810-4f73-9232-e17af2d53605 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:03.820523 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b4140490-4810-4f73-9232-e17af2d53605 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:03.822375 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b4140490-4810-4f73-9232-e17af2d53605 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:04.005642 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-b4140490-4810-4f73-9232-e17af2d53605 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:04.016031 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-b4140490-4810-4f73-9232-e17af2d53605 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1568 microversion: 2.1 time: 0.217165 Aug 07 04:57:04.017242 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 292/546] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:03 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1568 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:04.023466 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-9061108c-d5d5-463c-98c4-13df3a9ab454 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:57:04.024680 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-9061108c-d5d5-463c-98c4-13df3a9ab454 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:04.033518 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9061108c-d5d5-463c-98c4-13df3a9ab454 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:04.034317 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9061108c-d5d5-463c-98c4-13df3a9ab454 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:04.035342 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9061108c-d5d5-463c-98c4-13df3a9ab454 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:04.036022 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9061108c-d5d5-463c-98c4-13df3a9ab454 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:04.168349 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.virt.hardware [None req-7d01caec-dc54-4d40-87d5-c02432982ad4 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Flavor limits 0:0:0 {{(pid=107485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 04:57:04.168773 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.virt.hardware [None req-7d01caec-dc54-4d40-87d5-c02432982ad4 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Image limits 0:0:0 {{(pid=107485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 04:57:04.169255 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.virt.hardware [None req-7d01caec-dc54-4d40-87d5-c02432982ad4 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Flavor pref 0:0:0 {{(pid=107485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 04:57:04.169818 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.virt.hardware [None req-7d01caec-dc54-4d40-87d5-c02432982ad4 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Image pref 0:0:0 {{(pid=107485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 04:57:04.170375 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.virt.hardware [None req-7d01caec-dc54-4d40-87d5-c02432982ad4 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 04:57:04.190186 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7d01caec-dc54-4d40-87d5-c02432982ad4 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:04.190855 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7d01caec-dc54-4d40-87d5-c02432982ad4 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:04.192100 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7d01caec-dc54-4d40-87d5-c02432982ad4 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:04.192715 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7d01caec-dc54-4d40-87d5-c02432982ad4 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:04.212361 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-9061108c-d5d5-463c-98c4-13df3a9ab454 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 28634 microversion: 2.20 time: 0.193149 Aug 07 04:57:04.215308 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 293/547] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:57:04 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 28634 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:57:04.221003 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.quota [None req-7d01caec-dc54-4d40-87d5-c02432982ad4 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Getting quotas for project e90cab30a20644dbabb505e1ada2dc3a. Resources: {'ram', 'cores', 'instances'} {{(pid=107485) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 07 04:57:04.226082 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.quota [None req-7d01caec-dc54-4d40-87d5-c02432982ad4 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Getting quotas for user 1c71b131fcdb495d829a615ebae65aaa and project e90cab30a20644dbabb505e1ada2dc3a. Resources: {'ram', 'cores', 'instances'} {{(pid=107485) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 07 04:57:04.323283 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-7d01caec-dc54-4d40-87d5-c02432982ad4 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Going to run 1 instances... {{(pid=107485) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 07 04:57:04.332246 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-7d01caec-dc54-4d40-87d5-c02432982ad4 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 9842981a-3233-41c1-a42b-442492d50f3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c286e5e7-2a31-4ff3-875e-19ecb44e9a5c',volume_size=None,volume_type=None)] {{(pid=107485) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 07 04:57:04.554275 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-fffc62df-59e2-4477-a2a3-e2d477ceefd2 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:04.555537 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-fffc62df-59e2-4477-a2a3-e2d477ceefd2 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 4b54c939-5f03-4579-bb04-d01e73617541] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:04.567044 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-fffc62df-59e2-4477-a2a3-e2d477ceefd2 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:04.569997 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-fffc62df-59e2-4477-a2a3-e2d477ceefd2 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:04.570794 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-fffc62df-59e2-4477-a2a3-e2d477ceefd2 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:04.572159 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-fffc62df-59e2-4477-a2a3-e2d477ceefd2 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:04.661391 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-7d01caec-dc54-4d40-87d5-c02432982ad4 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.389004 Aug 07 04:57:04.670661 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 255/548] 10.222.0.35 () {60 vars in 1147 bytes} [Sat Aug 7 04:57:03 2021] POST /compute/v2.1/servers => generated 405 bytes in 1399 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 04:57:04.676939 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-b6952699-6c27-4e14-9c05-995930fa7974 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:04.677960 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-b6952699-6c27-4e14-9c05-995930fa7974 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 9842981a-3233-41c1-a42b-442492d50f3a] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:04.745628 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-fffc62df-59e2-4477-a2a3-e2d477ceefd2 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:04.755619 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-fffc62df-59e2-4477-a2a3-e2d477ceefd2 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541" status: 200 len: 1213 microversion: 2.1 time: 0.210753 Aug 07 04:57:04.757496 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 294/549] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:04 2021] GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541 => generated 1213 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:57:04.809770 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-b6952699-6c27-4e14-9c05-995930fa7974 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:04.824717 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-b6952699-6c27-4e14-9c05-995930fa7974 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a" status: 200 len: 1094 microversion: 2.1 time: 0.152889 Aug 07 04:57:04.828235 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 256/550] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:04 2021] GET /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a => generated 1094 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:05.040918 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-1e935732-c623-44cc-8bb6-17c22b1a510d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:05.044535 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-1e935732-c623-44cc-8bb6-17c22b1a510d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:05.095485 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1e935732-c623-44cc-8bb6-17c22b1a510d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:05.098747 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1e935732-c623-44cc-8bb6-17c22b1a510d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:05.099793 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1e935732-c623-44cc-8bb6-17c22b1a510d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:05.104990 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1e935732-c623-44cc-8bb6-17c22b1a510d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:05.225262 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-a871369e-0bef-49b1-8c54-ec8d33b3acdc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:57:05.226645 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-a871369e-0bef-49b1-8c54-ec8d33b3acdc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:05.239037 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a871369e-0bef-49b1-8c54-ec8d33b3acdc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:05.245299 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a871369e-0bef-49b1-8c54-ec8d33b3acdc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:05.246158 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a871369e-0bef-49b1-8c54-ec8d33b3acdc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:05.246608 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a871369e-0bef-49b1-8c54-ec8d33b3acdc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:05.360398 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-1e935732-c623-44cc-8bb6-17c22b1a510d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:05.375529 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-1e935732-c623-44cc-8bb6-17c22b1a510d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1568 microversion: 2.1 time: 0.342418 Aug 07 04:57:05.387026 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 295/551] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:05 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1568 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:05.410978 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-a871369e-0bef-49b1-8c54-ec8d33b3acdc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 28634 microversion: 2.20 time: 0.189570 Aug 07 04:57:05.411716 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 257/552] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:57:05 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 28634 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 07 04:57:05.773529 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-06cc9e1e-5f87-4e2c-8f20-01805f6a0ad9 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:05.774444 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-06cc9e1e-5f87-4e2c-8f20-01805f6a0ad9 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 4b54c939-5f03-4579-bb04-d01e73617541] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:05.782787 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-06cc9e1e-5f87-4e2c-8f20-01805f6a0ad9 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:05.793127 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-06cc9e1e-5f87-4e2c-8f20-01805f6a0ad9 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:05.797298 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-06cc9e1e-5f87-4e2c-8f20-01805f6a0ad9 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:05.797298 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-06cc9e1e-5f87-4e2c-8f20-01805f6a0ad9 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:05.847052 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-56d0bada-546b-41e1-a4d1-f26d59382059 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:05.847836 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-56d0bada-546b-41e1-a4d1-f26d59382059 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 9842981a-3233-41c1-a42b-442492d50f3a] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:05.868705 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-56d0bada-546b-41e1-a4d1-f26d59382059 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:05.870747 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-56d0bada-546b-41e1-a4d1-f26d59382059 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:05.876379 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-56d0bada-546b-41e1-a4d1-f26d59382059 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:05.878891 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-56d0bada-546b-41e1-a4d1-f26d59382059 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:05.905227 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-06cc9e1e-5f87-4e2c-8f20-01805f6a0ad9 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:05.931747 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-06cc9e1e-5f87-4e2c-8f20-01805f6a0ad9 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541" status: 200 len: 1269 microversion: 2.1 time: 0.160219 Aug 07 04:57:05.933906 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 296/553] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:05 2021] GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541 => generated 1269 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:06.023125 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-56d0bada-546b-41e1-a4d1-f26d59382059 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:06.033438 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-56d0bada-546b-41e1-a4d1-f26d59382059 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a" status: 200 len: 1192 microversion: 2.1 time: 0.190716 Aug 07 04:57:06.034546 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 258/554] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:05 2021] GET /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a => generated 1192 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:06.394078 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-a542588a-371d-47ce-96a4-a87ce2544744 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:06.394664 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-a542588a-371d-47ce-96a4-a87ce2544744 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:06.401625 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a542588a-371d-47ce-96a4-a87ce2544744 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:06.402380 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a542588a-371d-47ce-96a4-a87ce2544744 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:06.403594 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a542588a-371d-47ce-96a4-a87ce2544744 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:06.403999 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a542588a-371d-47ce-96a4-a87ce2544744 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:06.425800 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-ac2cf268-10f7-48f8-99c2-6181be5c5221 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:57:06.427410 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-ac2cf268-10f7-48f8-99c2-6181be5c5221 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:06.443446 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ac2cf268-10f7-48f8-99c2-6181be5c5221 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:06.444055 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ac2cf268-10f7-48f8-99c2-6181be5c5221 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:06.448578 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ac2cf268-10f7-48f8-99c2-6181be5c5221 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:06.449405 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ac2cf268-10f7-48f8-99c2-6181be5c5221 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:06.566596 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-ac2cf268-10f7-48f8-99c2-6181be5c5221 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 28634 microversion: 2.20 time: 0.146843 Aug 07 04:57:06.574750 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 259/555] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:57:06 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 28634 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 07 04:57:06.772260 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-a542588a-371d-47ce-96a4-a87ce2544744 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:06.783268 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-a542588a-371d-47ce-96a4-a87ce2544744 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1548 microversion: 2.1 time: 0.393085 Aug 07 04:57:06.783882 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 297/556] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:06 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1548 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:06.802108 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-c5f0c215-b4b6-446d-b204-c38282dea795 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:06.802743 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-c5f0c215-b4b6-446d-b204-c38282dea795 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:06.825277 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c5f0c215-b4b6-446d-b204-c38282dea795 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:06.825723 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c5f0c215-b4b6-446d-b204-c38282dea795 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:06.826518 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c5f0c215-b4b6-446d-b204-c38282dea795 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:06.826953 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c5f0c215-b4b6-446d-b204-c38282dea795 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:06.955778 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-79d17e78-86a2-4cf2-86ba-e5755c4d85a5 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:06.956453 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-79d17e78-86a2-4cf2-86ba-e5755c4d85a5 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 4b54c939-5f03-4579-bb04-d01e73617541] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:06.988549 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-79d17e78-86a2-4cf2-86ba-e5755c4d85a5 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:06.997098 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-79d17e78-86a2-4cf2-86ba-e5755c4d85a5 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:07.003487 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-79d17e78-86a2-4cf2-86ba-e5755c4d85a5 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:07.006812 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-79d17e78-86a2-4cf2-86ba-e5755c4d85a5 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:07.075556 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.wsgi [None req-c5f0c215-b4b6-446d-b204-c38282dea795 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] HTTP exception thrown: Cannot 'detach_volume' instance 90d6eef5-1c82-472b-adfb-aeaa1e93d502 while it is in vm_state rescued Aug 07 04:57:07.086176 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-c5f0c215-b4b6-446d-b204-c38282dea795 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Returning 409 to user: Cannot 'detach_volume' instance 90d6eef5-1c82-472b-adfb-aeaa1e93d502 while it is in vm_state rescued {{(pid=107485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 07 04:57:07.095616 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-c5f0c215-b4b6-446d-b204-c38282dea795 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "DELETE /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502/os-volume_attachments/f7a65ce4-134f-4ffa-bae8-835758889e7b" status: 409 len: 152 microversion: 2.1 time: 0.293725 Aug 07 04:57:07.101159 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 260/557] 10.222.0.35 () {58 vars in 1416 bytes} [Sat Aug 7 04:57:06 2021] DELETE /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502/os-volume_attachments/f7a65ce4-134f-4ffa-bae8-835758889e7b => generated 152 bytes in 306 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 07 04:57:07.117261 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-19abb0aa-f5a9-44cd-84c0-b9e6a3bb7357 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:07.121596 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-19abb0aa-f5a9-44cd-84c0-b9e6a3bb7357 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 9842981a-3233-41c1-a42b-442492d50f3a] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:07.141501 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-19abb0aa-f5a9-44cd-84c0-b9e6a3bb7357 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:07.142255 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-19abb0aa-f5a9-44cd-84c0-b9e6a3bb7357 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:07.143393 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-19abb0aa-f5a9-44cd-84c0-b9e6a3bb7357 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:07.143999 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-19abb0aa-f5a9-44cd-84c0-b9e6a3bb7357 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:07.314432 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-19abb0aa-f5a9-44cd-84c0-b9e6a3bb7357 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:07.325539 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-19abb0aa-f5a9-44cd-84c0-b9e6a3bb7357 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a" status: 200 len: 1210 microversion: 2.1 time: 0.214929 Aug 07 04:57:07.340085 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 261/558] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:07 2021] GET /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a => generated 1210 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:07.354804 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-5ff68f43-da48-4435-9c07-64b218e11f6e tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:57:07.355720 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-5ff68f43-da48-4435-9c07-64b218e11f6e tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:07.368826 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5ff68f43-da48-4435-9c07-64b218e11f6e tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:07.370011 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5ff68f43-da48-4435-9c07-64b218e11f6e tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:07.371305 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5ff68f43-da48-4435-9c07-64b218e11f6e tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:07.371906 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5ff68f43-da48-4435-9c07-64b218e11f6e tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:07.383502 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-79d17e78-86a2-4cf2-86ba-e5755c4d85a5 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:07.399131 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-79d17e78-86a2-4cf2-86ba-e5755c4d85a5 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541" status: 200 len: 1317 microversion: 2.1 time: 0.444467 Aug 07 04:57:07.402067 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 298/559] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:06 2021] GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541 => generated 1317 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:07.484071 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-5ff68f43-da48-4435-9c07-64b218e11f6e tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "POST /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502/action" status: 202 len: 0 microversion: 2.1 time: 0.141149 Aug 07 04:57:07.487621 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 262/560] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 04:57:07 2021] POST /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:57:07.493159 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-8bd3e84b-98bc-476f-abef-2dbf10515385 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:07.493992 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-8bd3e84b-98bc-476f-abef-2dbf10515385 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:07.503474 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8bd3e84b-98bc-476f-abef-2dbf10515385 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:07.503923 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8bd3e84b-98bc-476f-abef-2dbf10515385 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:07.504825 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8bd3e84b-98bc-476f-abef-2dbf10515385 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:07.505181 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8bd3e84b-98bc-476f-abef-2dbf10515385 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:07.582619 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-b8b99bd5-8863-4791-93d1-3dd1ff143f74 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:57:07.584324 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-b8b99bd5-8863-4791-93d1-3dd1ff143f74 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:07.604816 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b8b99bd5-8863-4791-93d1-3dd1ff143f74 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:07.606616 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b8b99bd5-8863-4791-93d1-3dd1ff143f74 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:07.614012 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b8b99bd5-8863-4791-93d1-3dd1ff143f74 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:07.614012 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b8b99bd5-8863-4791-93d1-3dd1ff143f74 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:07.671340 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-8bd3e84b-98bc-476f-abef-2dbf10515385 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:07.680611 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-8bd3e84b-98bc-476f-abef-2dbf10515385 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1556 microversion: 2.1 time: 0.191141 Aug 07 04:57:07.681231 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 299/561] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:07 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1556 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:08.344139 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-57402d3b-73d6-4ccb-8de9-00e1ed7cecf1 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:08.345113 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-57402d3b-73d6-4ccb-8de9-00e1ed7cecf1 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 9842981a-3233-41c1-a42b-442492d50f3a] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:08.354816 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-57402d3b-73d6-4ccb-8de9-00e1ed7cecf1 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:08.355594 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-57402d3b-73d6-4ccb-8de9-00e1ed7cecf1 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:08.356588 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-57402d3b-73d6-4ccb-8de9-00e1ed7cecf1 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:08.357397 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-57402d3b-73d6-4ccb-8de9-00e1ed7cecf1 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:08.562333 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-57402d3b-73d6-4ccb-8de9-00e1ed7cecf1 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:08.570442 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-57402d3b-73d6-4ccb-8de9-00e1ed7cecf1 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a" status: 200 len: 1277 microversion: 2.1 time: 0.230133 Aug 07 04:57:08.571588 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 300/562] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:08 2021] GET /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a => generated 1277 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:08.578129 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-fe207ebb-bbad-44aa-b7bf-86bf77c08263 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:08.578957 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-fe207ebb-bbad-44aa-b7bf-86bf77c08263 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 4b54c939-5f03-4579-bb04-d01e73617541] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:08.586488 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-fe207ebb-bbad-44aa-b7bf-86bf77c08263 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:08.587077 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-fe207ebb-bbad-44aa-b7bf-86bf77c08263 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:08.587782 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-fe207ebb-bbad-44aa-b7bf-86bf77c08263 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:08.589126 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-fe207ebb-bbad-44aa-b7bf-86bf77c08263 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:08.729985 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-fe207ebb-bbad-44aa-b7bf-86bf77c08263 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:08.737721 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-fe207ebb-bbad-44aa-b7bf-86bf77c08263 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541" status: 200 len: 1317 microversion: 2.1 time: 0.163114 Aug 07 04:57:08.738282 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 301/563] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:08 2021] GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:08.742754 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-ca98e432-a8f3-42f3-a4f7-1615d35cdedc tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:08.743347 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-ca98e432-a8f3-42f3-a4f7-1615d35cdedc tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:08.749658 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ca98e432-a8f3-42f3-a4f7-1615d35cdedc tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:08.750101 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ca98e432-a8f3-42f3-a4f7-1615d35cdedc tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:08.750855 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ca98e432-a8f3-42f3-a4f7-1615d35cdedc tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:08.751286 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ca98e432-a8f3-42f3-a4f7-1615d35cdedc tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:08.868458 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-ca98e432-a8f3-42f3-a4f7-1615d35cdedc tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:08.876885 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-ca98e432-a8f3-42f3-a4f7-1615d35cdedc tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1556 microversion: 2.1 time: 0.137655 Aug 07 04:57:08.877438 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 302/564] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:08 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1556 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:09.591212 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-72a29c68-4370-485f-8ed9-453173f7460f tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:09.591883 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-72a29c68-4370-485f-8ed9-453173f7460f tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 9842981a-3233-41c1-a42b-442492d50f3a] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:09.597697 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-72a29c68-4370-485f-8ed9-453173f7460f tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:09.598138 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-72a29c68-4370-485f-8ed9-453173f7460f tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:09.598895 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-72a29c68-4370-485f-8ed9-453173f7460f tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:09.599326 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-72a29c68-4370-485f-8ed9-453173f7460f tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:09.719142 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-72a29c68-4370-485f-8ed9-453173f7460f tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:09.726299 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-72a29c68-4370-485f-8ed9-453173f7460f tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a" status: 200 len: 1277 microversion: 2.1 time: 0.139199 Aug 07 04:57:09.726855 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 303/565] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:09 2021] GET /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a => generated 1277 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:57:09.754608 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-be7997b4-b3b9-4d90-a315-25f9c1c73647 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:09.755213 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-be7997b4-b3b9-4d90-a315-25f9c1c73647 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 4b54c939-5f03-4579-bb04-d01e73617541] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:09.761585 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-be7997b4-b3b9-4d90-a315-25f9c1c73647 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:09.762023 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-be7997b4-b3b9-4d90-a315-25f9c1c73647 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:09.762774 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-be7997b4-b3b9-4d90-a315-25f9c1c73647 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:09.763201 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-be7997b4-b3b9-4d90-a315-25f9c1c73647 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:09.882953 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-be7997b4-b3b9-4d90-a315-25f9c1c73647 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:09.890219 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-be7997b4-b3b9-4d90-a315-25f9c1c73647 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541" status: 200 len: 1317 microversion: 2.1 time: 0.139032 Aug 07 04:57:09.890838 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 304/566] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:09 2021] GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541 => generated 1317 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:57:09.899226 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-04145677-25b6-4383-855c-2ed746d9aa2d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:09.899226 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-04145677-25b6-4383-855c-2ed746d9aa2d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:09.901137 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-04145677-25b6-4383-855c-2ed746d9aa2d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:09.901580 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-04145677-25b6-4383-855c-2ed746d9aa2d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:09.902338 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-04145677-25b6-4383-855c-2ed746d9aa2d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:09.902767 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-04145677-25b6-4383-855c-2ed746d9aa2d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:10.021494 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-04145677-25b6-4383-855c-2ed746d9aa2d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:10.029636 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-04145677-25b6-4383-855c-2ed746d9aa2d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1556 microversion: 2.1 time: 0.137808 Aug 07 04:57:10.030238 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 305/567] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:09 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1556 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:10.743351 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-b22920cf-ffb7-4ccc-867f-9d0b6e18ffe6 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:10.744333 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-b22920cf-ffb7-4ccc-867f-9d0b6e18ffe6 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 9842981a-3233-41c1-a42b-442492d50f3a] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:10.750316 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b22920cf-ffb7-4ccc-867f-9d0b6e18ffe6 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:10.750786 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b22920cf-ffb7-4ccc-867f-9d0b6e18ffe6 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:10.751829 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b22920cf-ffb7-4ccc-867f-9d0b6e18ffe6 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:10.751969 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b22920cf-ffb7-4ccc-867f-9d0b6e18ffe6 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:11.000549 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-b22920cf-ffb7-4ccc-867f-9d0b6e18ffe6 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:11.008369 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-b22920cf-ffb7-4ccc-867f-9d0b6e18ffe6 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a" status: 200 len: 1277 microversion: 2.1 time: 0.269200 Aug 07 04:57:11.009108 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 306/568] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:10 2021] GET /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a => generated 1277 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:57:11.013846 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-86336984-e282-49bc-8b85-bfc39093d396 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:11.014465 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-86336984-e282-49bc-8b85-bfc39093d396 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 4b54c939-5f03-4579-bb04-d01e73617541] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:11.021751 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-86336984-e282-49bc-8b85-bfc39093d396 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:11.022523 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-86336984-e282-49bc-8b85-bfc39093d396 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:11.022964 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-86336984-e282-49bc-8b85-bfc39093d396 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:11.023402 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-86336984-e282-49bc-8b85-bfc39093d396 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:11.260542 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-86336984-e282-49bc-8b85-bfc39093d396 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:11.269239 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-86336984-e282-49bc-8b85-bfc39093d396 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541" status: 200 len: 1317 microversion: 2.1 time: 0.259201 Aug 07 04:57:11.278637 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 307/569] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:11 2021] GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541 => generated 1317 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:11.285121 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-ae3f942a-4284-4916-bcd3-ec4f128ac4bf tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:11.285868 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-ae3f942a-4284-4916-bcd3-ec4f128ac4bf tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:11.293102 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ae3f942a-4284-4916-bcd3-ec4f128ac4bf tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:11.293686 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ae3f942a-4284-4916-bcd3-ec4f128ac4bf tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:11.294546 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ae3f942a-4284-4916-bcd3-ec4f128ac4bf tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:11.295058 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ae3f942a-4284-4916-bcd3-ec4f128ac4bf tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:11.530424 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-ae3f942a-4284-4916-bcd3-ec4f128ac4bf tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:11.538363 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-ae3f942a-4284-4916-bcd3-ec4f128ac4bf tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1556 microversion: 2.1 time: 0.258421 Aug 07 04:57:11.539042 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 308/570] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:11 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1556 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:11.543743 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [req-a0227643-7a36-4e00-ae3d-49176cfac8eb req-e3ee4f12-b09b-4403-91ad-438445502063 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9842981a-3233-41c1-a42b-442492d50f3a", "tag": "8625acb3-8bac-4659-9273-7a1a3bc30dc6"}]} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:57:11.545434 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 04:57:11.545434 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: warnings.warn(msg) Aug 07 04:57:11.552341 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-a0227643-7a36-4e00-ae3d-49176cfac8eb req-e3ee4f12-b09b-4403-91ad-438445502063 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:11.552952 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-a0227643-7a36-4e00-ae3d-49176cfac8eb req-e3ee4f12-b09b-4403-91ad-438445502063 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:11.563886 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.compute.server_external_events [req-a0227643-7a36-4e00-ae3d-49176cfac8eb req-e3ee4f12-b09b-4403-91ad-438445502063 service nova] Creating event network-changed:8625acb3-8bac-4659-9273-7a1a3bc30dc6 for instance 9842981a-3233-41c1-a42b-442492d50f3a on hv-cinder-80374 Aug 07 04:57:11.568391 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [req-a0227643-7a36-4e00-ae3d-49176cfac8eb req-e3ee4f12-b09b-4403-91ad-438445502063 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028197 Aug 07 04:57:11.568997 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 309/571] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 04:57:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:57:11.575591 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [req-d6892f53-870b-42ab-af21-68bba3c6e455 req-81a240eb-6ce0-43f9-b07f-6070a32c8fa9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b54c939-5f03-4579-bb04-d01e73617541", "tag": "bf23d849-0e24-47ab-ae33-6002837e92e0"}]} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:57:11.577144 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 04:57:11.577144 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: warnings.warn(msg) Aug 07 04:57:11.584105 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-d6892f53-870b-42ab-af21-68bba3c6e455 req-81a240eb-6ce0-43f9-b07f-6070a32c8fa9 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:11.584552 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-d6892f53-870b-42ab-af21-68bba3c6e455 req-81a240eb-6ce0-43f9-b07f-6070a32c8fa9 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:11.595986 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.compute.server_external_events [req-d6892f53-870b-42ab-af21-68bba3c6e455 req-81a240eb-6ce0-43f9-b07f-6070a32c8fa9 service nova] Creating event network-changed:bf23d849-0e24-47ab-ae33-6002837e92e0 for instance 4b54c939-5f03-4579-bb04-d01e73617541 on hv-cinder-80374 Aug 07 04:57:11.600489 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [req-d6892f53-870b-42ab-af21-68bba3c6e455 req-81a240eb-6ce0-43f9-b07f-6070a32c8fa9 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029428 Aug 07 04:57:11.601106 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 310/572] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 04:57:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:57:12.025277 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-b72580be-8011-43d0-9f6a-511183955335 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:12.026334 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-b72580be-8011-43d0-9f6a-511183955335 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 9842981a-3233-41c1-a42b-442492d50f3a] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:12.032467 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b72580be-8011-43d0-9f6a-511183955335 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:12.032943 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b72580be-8011-43d0-9f6a-511183955335 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:12.033737 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b72580be-8011-43d0-9f6a-511183955335 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:12.034164 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b72580be-8011-43d0-9f6a-511183955335 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:12.153457 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-b72580be-8011-43d0-9f6a-511183955335 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:12.161030 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-b72580be-8011-43d0-9f6a-511183955335 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a" status: 200 len: 1277 microversion: 2.1 time: 0.139797 Aug 07 04:57:12.161585 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 311/573] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:12 2021] GET /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a => generated 1277 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:57:12.238269 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-b8b99bd5-8863-4791-93d1-3dd1ff143f74 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 28634 microversion: 2.20 time: 4.662126 Aug 07 04:57:12.239135 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 263/574] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:57:07 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 28634 bytes in 4664 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 07 04:57:12.288902 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-1180f447-5321-4acd-8440-d7687e379064 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:12.289615 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-1180f447-5321-4acd-8440-d7687e379064 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 4b54c939-5f03-4579-bb04-d01e73617541] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:12.296926 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1180f447-5321-4acd-8440-d7687e379064 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:12.297369 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1180f447-5321-4acd-8440-d7687e379064 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:12.298136 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1180f447-5321-4acd-8440-d7687e379064 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:12.298563 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1180f447-5321-4acd-8440-d7687e379064 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:12.420179 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-1180f447-5321-4acd-8440-d7687e379064 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:12.440368 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-1180f447-5321-4acd-8440-d7687e379064 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541" status: 200 len: 1317 microversion: 2.1 time: 0.157586 Aug 07 04:57:12.458494 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 312/575] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:12 2021] GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541 => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:12.557541 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-f9b4edaf-5a63-4e1b-be80-daf5af6c36f0 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:12.558235 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-f9b4edaf-5a63-4e1b-be80-daf5af6c36f0 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:12.577235 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f9b4edaf-5a63-4e1b-be80-daf5af6c36f0 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:12.577682 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f9b4edaf-5a63-4e1b-be80-daf5af6c36f0 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:12.578476 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f9b4edaf-5a63-4e1b-be80-daf5af6c36f0 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:12.578907 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f9b4edaf-5a63-4e1b-be80-daf5af6c36f0 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:12.882051 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-f9b4edaf-5a63-4e1b-be80-daf5af6c36f0 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:12.897819 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-f9b4edaf-5a63-4e1b-be80-daf5af6c36f0 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1556 microversion: 2.1 time: 0.344544 Aug 07 04:57:12.898574 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 264/576] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:12 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1556 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:13.178515 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-6ebd7cbf-b618-4a3d-9b0f-f63684225d5c tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:13.179362 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-6ebd7cbf-b618-4a3d-9b0f-f63684225d5c tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 9842981a-3233-41c1-a42b-442492d50f3a] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:13.188223 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6ebd7cbf-b618-4a3d-9b0f-f63684225d5c tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:13.188706 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6ebd7cbf-b618-4a3d-9b0f-f63684225d5c tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:13.189549 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6ebd7cbf-b618-4a3d-9b0f-f63684225d5c tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:13.190188 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6ebd7cbf-b618-4a3d-9b0f-f63684225d5c tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:13.250621 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-cdd73433-ae53-432a-81e9-688c47ab7cd1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:57:13.251548 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-cdd73433-ae53-432a-81e9-688c47ab7cd1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:13.262129 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-cdd73433-ae53-432a-81e9-688c47ab7cd1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:13.263631 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-cdd73433-ae53-432a-81e9-688c47ab7cd1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:13.264617 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-cdd73433-ae53-432a-81e9-688c47ab7cd1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:13.265086 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-cdd73433-ae53-432a-81e9-688c47ab7cd1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:13.420975 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-cdd73433-ae53-432a-81e9-688c47ab7cd1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 28634 microversion: 2.20 time: 0.173830 Aug 07 04:57:13.422302 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 265/577] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:57:13 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 28634 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 07 04:57:13.467067 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-daac59b9-e3af-4430-bb05-cd9979e791a6 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:13.468829 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-daac59b9-e3af-4430-bb05-cd9979e791a6 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 4b54c939-5f03-4579-bb04-d01e73617541] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:13.477640 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-daac59b9-e3af-4430-bb05-cd9979e791a6 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:13.479143 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-daac59b9-e3af-4430-bb05-cd9979e791a6 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:13.480440 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-daac59b9-e3af-4430-bb05-cd9979e791a6 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:13.481888 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-daac59b9-e3af-4430-bb05-cd9979e791a6 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:13.596738 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-6ebd7cbf-b618-4a3d-9b0f-f63684225d5c tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:13.613019 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-6ebd7cbf-b618-4a3d-9b0f-f63684225d5c tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a" status: 200 len: 1277 microversion: 2.1 time: 0.438442 Aug 07 04:57:13.624405 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 313/578] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:13 2021] GET /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a => generated 1277 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:13.771469 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-daac59b9-e3af-4430-bb05-cd9979e791a6 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:13.781699 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-daac59b9-e3af-4430-bb05-cd9979e791a6 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541" status: 200 len: 1317 microversion: 2.1 time: 0.319384 Aug 07 04:57:13.795507 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 266/579] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:13 2021] GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541 => generated 1317 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:57:13.917065 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-0c4992cf-f9fc-456c-904b-ec1ede9c2aeb tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:13.917683 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-0c4992cf-f9fc-456c-904b-ec1ede9c2aeb tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:13.929175 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0c4992cf-f9fc-456c-904b-ec1ede9c2aeb tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:13.929624 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0c4992cf-f9fc-456c-904b-ec1ede9c2aeb tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:13.931183 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0c4992cf-f9fc-456c-904b-ec1ede9c2aeb tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:13.931852 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0c4992cf-f9fc-456c-904b-ec1ede9c2aeb tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:14.199885 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-0c4992cf-f9fc-456c-904b-ec1ede9c2aeb tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:14.210731 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-0c4992cf-f9fc-456c-904b-ec1ede9c2aeb tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1556 microversion: 2.1 time: 0.296609 Aug 07 04:57:14.213882 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 314/580] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:13 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1556 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:14.433312 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-4f6a3c8a-25d4-429e-a808-1ca7b02a53a0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:57:14.434289 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-4f6a3c8a-25d4-429e-a808-1ca7b02a53a0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:14.441112 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4f6a3c8a-25d4-429e-a808-1ca7b02a53a0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:14.441540 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4f6a3c8a-25d4-429e-a808-1ca7b02a53a0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:14.442314 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4f6a3c8a-25d4-429e-a808-1ca7b02a53a0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:14.442743 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4f6a3c8a-25d4-429e-a808-1ca7b02a53a0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:14.629948 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-89f134e7-0c1d-46ae-8467-5b837fd5fba4 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:14.630563 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-89f134e7-0c1d-46ae-8467-5b837fd5fba4 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 9842981a-3233-41c1-a42b-442492d50f3a] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:14.640834 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-89f134e7-0c1d-46ae-8467-5b837fd5fba4 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:14.641366 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-89f134e7-0c1d-46ae-8467-5b837fd5fba4 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:14.642147 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-89f134e7-0c1d-46ae-8467-5b837fd5fba4 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:14.642581 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-89f134e7-0c1d-46ae-8467-5b837fd5fba4 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:14.778320 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-89f134e7-0c1d-46ae-8467-5b837fd5fba4 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:14.788424 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-89f134e7-0c1d-46ae-8467-5b837fd5fba4 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a" status: 200 len: 1277 microversion: 2.1 time: 0.162266 Aug 07 04:57:14.801064 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 315/581] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:14 2021] GET /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a => generated 1277 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:57:14.807291 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-8d678ace-90e3-4cad-8837-b977f8a7c198 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:14.808327 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-8d678ace-90e3-4cad-8837-b977f8a7c198 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 4b54c939-5f03-4579-bb04-d01e73617541] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:14.814976 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8d678ace-90e3-4cad-8837-b977f8a7c198 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:14.815511 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8d678ace-90e3-4cad-8837-b977f8a7c198 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:14.816619 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8d678ace-90e3-4cad-8837-b977f8a7c198 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:14.817257 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8d678ace-90e3-4cad-8837-b977f8a7c198 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:14.959116 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-8d678ace-90e3-4cad-8837-b977f8a7c198 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:14.967820 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-8d678ace-90e3-4cad-8837-b977f8a7c198 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541" status: 200 len: 1317 microversion: 2.1 time: 0.165303 Aug 07 04:57:14.968683 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 316/582] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:14 2021] GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:15.177308 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-4f6a3c8a-25d4-429e-a808-1ca7b02a53a0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 28634 microversion: 2.20 time: 0.747379 Aug 07 04:57:15.178196 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 267/583] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:57:14 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 28634 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:57:15.231553 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-77c0819a-6106-46cb-8fb9-7b5c38ad56e1 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:15.232887 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-77c0819a-6106-46cb-8fb9-7b5c38ad56e1 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:15.239585 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-77c0819a-6106-46cb-8fb9-7b5c38ad56e1 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:15.240035 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-77c0819a-6106-46cb-8fb9-7b5c38ad56e1 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:15.240849 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-77c0819a-6106-46cb-8fb9-7b5c38ad56e1 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:15.241285 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-77c0819a-6106-46cb-8fb9-7b5c38ad56e1 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:15.476954 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-77c0819a-6106-46cb-8fb9-7b5c38ad56e1 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:15.487916 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-77c0819a-6106-46cb-8fb9-7b5c38ad56e1 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1556 microversion: 2.1 time: 0.260871 Aug 07 04:57:15.489115 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 317/584] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:15 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1556 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:15.809088 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-9042c1b5-7866-452a-ac4e-35aa20a1bedb tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:15.810624 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-9042c1b5-7866-452a-ac4e-35aa20a1bedb tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 9842981a-3233-41c1-a42b-442492d50f3a] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:15.817544 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9042c1b5-7866-452a-ac4e-35aa20a1bedb tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:15.818202 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9042c1b5-7866-452a-ac4e-35aa20a1bedb tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:15.819001 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9042c1b5-7866-452a-ac4e-35aa20a1bedb tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:15.819598 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9042c1b5-7866-452a-ac4e-35aa20a1bedb tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:15.947589 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-9042c1b5-7866-452a-ac4e-35aa20a1bedb tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:15.957393 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-9042c1b5-7866-452a-ac4e-35aa20a1bedb tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a" status: 200 len: 1265 microversion: 2.1 time: 0.153030 Aug 07 04:57:15.960003 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 268/585] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:15 2021] GET /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:15.984837 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-97ef773a-5b6e-4d3b-81b0-2b51a372e5dd tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:15.985521 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-97ef773a-5b6e-4d3b-81b0-2b51a372e5dd tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 4b54c939-5f03-4579-bb04-d01e73617541] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:15.991316 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-97ef773a-5b6e-4d3b-81b0-2b51a372e5dd tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:15.991797 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-97ef773a-5b6e-4d3b-81b0-2b51a372e5dd tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:15.992546 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-97ef773a-5b6e-4d3b-81b0-2b51a372e5dd tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:15.993004 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-97ef773a-5b6e-4d3b-81b0-2b51a372e5dd tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:16.113191 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-97ef773a-5b6e-4d3b-81b0-2b51a372e5dd tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:16.121122 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-97ef773a-5b6e-4d3b-81b0-2b51a372e5dd tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541" status: 200 len: 1317 microversion: 2.1 time: 0.139873 Aug 07 04:57:16.121687 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 318/586] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:15 2021] GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541 => generated 1317 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:16.191358 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-8e601ae9-205e-4f09-b2df-62a3197e3fd4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:57:16.193187 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-8e601ae9-205e-4f09-b2df-62a3197e3fd4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:16.199738 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8e601ae9-205e-4f09-b2df-62a3197e3fd4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:16.200127 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8e601ae9-205e-4f09-b2df-62a3197e3fd4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:16.200927 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8e601ae9-205e-4f09-b2df-62a3197e3fd4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:16.201361 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8e601ae9-205e-4f09-b2df-62a3197e3fd4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:16.508319 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-26601048-4087-48d9-ae8a-b86462eee3c6 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:16.509097 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-26601048-4087-48d9-ae8a-b86462eee3c6 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:16.518418 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-26601048-4087-48d9-ae8a-b86462eee3c6 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:16.519442 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-26601048-4087-48d9-ae8a-b86462eee3c6 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:16.520551 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-26601048-4087-48d9-ae8a-b86462eee3c6 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:16.521350 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-26601048-4087-48d9-ae8a-b86462eee3c6 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:16.625534 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-8e601ae9-205e-4f09-b2df-62a3197e3fd4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 28634 microversion: 2.20 time: 0.439400 Aug 07 04:57:16.626567 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 269/587] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:57:16 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 28634 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:57:16.698923 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-26601048-4087-48d9-ae8a-b86462eee3c6 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:16.708250 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-26601048-4087-48d9-ae8a-b86462eee3c6 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1556 microversion: 2.1 time: 0.205465 Aug 07 04:57:16.709555 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 319/588] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:16 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1556 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:57:16.977193 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-30474781-9547-420b-9e3c-20b27fc94861 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:16.977897 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-30474781-9547-420b-9e3c-20b27fc94861 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 9842981a-3233-41c1-a42b-442492d50f3a] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:16.985452 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-30474781-9547-420b-9e3c-20b27fc94861 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:16.985902 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-30474781-9547-420b-9e3c-20b27fc94861 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:16.986740 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-30474781-9547-420b-9e3c-20b27fc94861 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:16.987175 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-30474781-9547-420b-9e3c-20b27fc94861 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:17.116228 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-30474781-9547-420b-9e3c-20b27fc94861 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:17.124719 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-30474781-9547-420b-9e3c-20b27fc94861 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a" status: 200 len: 1265 microversion: 2.1 time: 0.153426 Aug 07 04:57:17.136899 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 270/589] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:16 2021] GET /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:17.142150 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-d532f8b0-112c-45ee-a273-a705987a81e6 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:17.142762 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-d532f8b0-112c-45ee-a273-a705987a81e6 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 4b54c939-5f03-4579-bb04-d01e73617541] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:17.149263 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d532f8b0-112c-45ee-a273-a705987a81e6 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:17.149823 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d532f8b0-112c-45ee-a273-a705987a81e6 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:17.151179 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d532f8b0-112c-45ee-a273-a705987a81e6 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:17.151630 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d532f8b0-112c-45ee-a273-a705987a81e6 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:17.291390 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-d532f8b0-112c-45ee-a273-a705987a81e6 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:17.300192 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-d532f8b0-112c-45ee-a273-a705987a81e6 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541" status: 200 len: 1317 microversion: 2.1 time: 0.161750 Aug 07 04:57:17.300846 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 320/590] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:17 2021] GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:17.640604 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-15c351dc-b043-424c-bf58-350239a2a171 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:57:17.641526 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-15c351dc-b043-424c-bf58-350239a2a171 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:17.647724 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-15c351dc-b043-424c-bf58-350239a2a171 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:17.648398 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-15c351dc-b043-424c-bf58-350239a2a171 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:17.649384 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-15c351dc-b043-424c-bf58-350239a2a171 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:17.650009 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-15c351dc-b043-424c-bf58-350239a2a171 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:17.727528 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-acad2da9-581e-4f2d-9ad0-e154cb5b55da tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:17.729348 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-acad2da9-581e-4f2d-9ad0-e154cb5b55da tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:17.737800 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-acad2da9-581e-4f2d-9ad0-e154cb5b55da tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:17.738348 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-acad2da9-581e-4f2d-9ad0-e154cb5b55da tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:17.740178 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-acad2da9-581e-4f2d-9ad0-e154cb5b55da tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:17.740726 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-acad2da9-581e-4f2d-9ad0-e154cb5b55da tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:17.763073 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-15c351dc-b043-424c-bf58-350239a2a171 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 28634 microversion: 2.20 time: 0.125932 Aug 07 04:57:17.768325 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 271/591] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:57:17 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 28634 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:57:17.881023 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-acad2da9-581e-4f2d-9ad0-e154cb5b55da tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:17.896925 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-acad2da9-581e-4f2d-9ad0-e154cb5b55da tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1556 microversion: 2.1 time: 0.173742 Aug 07 04:57:17.907562 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 321/592] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:17 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1556 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:57:18.143905 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-84407b92-bd41-4bcc-8e16-d475da2ffa46 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:18.145026 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-84407b92-bd41-4bcc-8e16-d475da2ffa46 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 9842981a-3233-41c1-a42b-442492d50f3a] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:18.159223 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-84407b92-bd41-4bcc-8e16-d475da2ffa46 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:18.159914 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-84407b92-bd41-4bcc-8e16-d475da2ffa46 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:18.160944 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-84407b92-bd41-4bcc-8e16-d475da2ffa46 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:18.161572 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-84407b92-bd41-4bcc-8e16-d475da2ffa46 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:18.326113 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-6b57d645-672c-48b1-a16a-7d942b760c4d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:18.326737 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-6b57d645-672c-48b1-a16a-7d942b760c4d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 4b54c939-5f03-4579-bb04-d01e73617541] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:18.347985 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6b57d645-672c-48b1-a16a-7d942b760c4d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:18.348499 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6b57d645-672c-48b1-a16a-7d942b760c4d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:18.349627 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6b57d645-672c-48b1-a16a-7d942b760c4d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:18.349905 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6b57d645-672c-48b1-a16a-7d942b760c4d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:18.404324 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-84407b92-bd41-4bcc-8e16-d475da2ffa46 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:18.414687 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-84407b92-bd41-4bcc-8e16-d475da2ffa46 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a" status: 200 len: 1265 microversion: 2.1 time: 0.273416 Aug 07 04:57:18.416287 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 272/593] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:18 2021] GET /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a => generated 1265 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:18.584931 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-6b57d645-672c-48b1-a16a-7d942b760c4d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:18.596108 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-6b57d645-672c-48b1-a16a-7d942b760c4d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541" status: 200 len: 1317 microversion: 2.1 time: 0.276400 Aug 07 04:57:18.597450 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 322/594] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:18 2021] GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541 => generated 1317 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:18.775594 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-74057c8b-b683-48a7-b6cc-2d28b4a0a456 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:57:18.776517 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-74057c8b-b683-48a7-b6cc-2d28b4a0a456 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:18.784984 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-74057c8b-b683-48a7-b6cc-2d28b4a0a456 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:18.785702 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-74057c8b-b683-48a7-b6cc-2d28b4a0a456 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:18.786681 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-74057c8b-b683-48a7-b6cc-2d28b4a0a456 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:18.787289 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-74057c8b-b683-48a7-b6cc-2d28b4a0a456 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:18.914675 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-3731ae29-2fb2-416e-84e3-625806ab0d79 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:18.916588 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-3731ae29-2fb2-416e-84e3-625806ab0d79 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:18.937522 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3731ae29-2fb2-416e-84e3-625806ab0d79 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:18.938364 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3731ae29-2fb2-416e-84e3-625806ab0d79 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:18.939401 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3731ae29-2fb2-416e-84e3-625806ab0d79 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:18.940097 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3731ae29-2fb2-416e-84e3-625806ab0d79 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:19.065467 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-74057c8b-b683-48a7-b6cc-2d28b4a0a456 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 29240 microversion: 2.20 time: 0.293636 Aug 07 04:57:19.066260 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 273/595] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:57:18 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 29240 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:57:19.178891 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-3731ae29-2fb2-416e-84e3-625806ab0d79 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:19.197247 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-3731ae29-2fb2-416e-84e3-625806ab0d79 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1556 microversion: 2.1 time: 0.286151 Aug 07 04:57:19.208618 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 323/596] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:18 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1556 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:19.435752 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-539f35d7-4c49-4978-a79d-f48de95069db tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:19.436450 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-539f35d7-4c49-4978-a79d-f48de95069db tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 9842981a-3233-41c1-a42b-442492d50f3a] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:19.445312 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-539f35d7-4c49-4978-a79d-f48de95069db tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:19.446138 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-539f35d7-4c49-4978-a79d-f48de95069db tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:19.447128 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-539f35d7-4c49-4978-a79d-f48de95069db tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:19.447760 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-539f35d7-4c49-4978-a79d-f48de95069db tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:19.614266 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-45266ab9-8e0e-4437-b0e2-9bc8dc98be2d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:19.615223 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-45266ab9-8e0e-4437-b0e2-9bc8dc98be2d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 4b54c939-5f03-4579-bb04-d01e73617541] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:19.624552 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-45266ab9-8e0e-4437-b0e2-9bc8dc98be2d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:19.627730 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-45266ab9-8e0e-4437-b0e2-9bc8dc98be2d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:19.631402 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-45266ab9-8e0e-4437-b0e2-9bc8dc98be2d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:19.632130 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-45266ab9-8e0e-4437-b0e2-9bc8dc98be2d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:19.635022 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-539f35d7-4c49-4978-a79d-f48de95069db tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:19.650486 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-539f35d7-4c49-4978-a79d-f48de95069db tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a" status: 200 len: 1265 microversion: 2.1 time: 0.217905 Aug 07 04:57:19.660349 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 274/597] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:19 2021] GET /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a => generated 1265 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:19.791625 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-45266ab9-8e0e-4437-b0e2-9bc8dc98be2d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:19.801060 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-45266ab9-8e0e-4437-b0e2-9bc8dc98be2d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541" status: 200 len: 1317 microversion: 2.1 time: 0.190182 Aug 07 04:57:19.816856 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 324/598] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:19 2021] GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541 => generated 1317 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:20.079053 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-560cd860-2df9-4c6d-a205-d958afcf6dcc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:57:20.080440 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-560cd860-2df9-4c6d-a205-d958afcf6dcc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:20.094276 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-560cd860-2df9-4c6d-a205-d958afcf6dcc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:20.094949 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-560cd860-2df9-4c6d-a205-d958afcf6dcc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:20.095944 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-560cd860-2df9-4c6d-a205-d958afcf6dcc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:20.096558 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-560cd860-2df9-4c6d-a205-d958afcf6dcc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:20.218426 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-f36c2453-c9ed-43bc-ab97-3614af6830f0 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:20.219573 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-f36c2453-c9ed-43bc-ab97-3614af6830f0 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:20.231837 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-560cd860-2df9-4c6d-a205-d958afcf6dcc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 30777 microversion: 2.20 time: 0.157115 Aug 07 04:57:20.233468 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 275/599] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:57:20 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 30777 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 07 04:57:20.249946 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f36c2453-c9ed-43bc-ab97-3614af6830f0 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:20.250699 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f36c2453-c9ed-43bc-ab97-3614af6830f0 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:20.251826 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f36c2453-c9ed-43bc-ab97-3614af6830f0 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:20.252427 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f36c2453-c9ed-43bc-ab97-3614af6830f0 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:20.531946 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-f36c2453-c9ed-43bc-ab97-3614af6830f0 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:20.543640 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-f36c2453-c9ed-43bc-ab97-3614af6830f0 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1562 microversion: 2.1 time: 0.331629 Aug 07 04:57:20.544777 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 325/600] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:20 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1562 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:57:20.668226 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-2d89040e-2cad-4e8f-8b65-31167b6ec2c0 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:20.671080 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-2d89040e-2cad-4e8f-8b65-31167b6ec2c0 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 9842981a-3233-41c1-a42b-442492d50f3a] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:20.684693 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2d89040e-2cad-4e8f-8b65-31167b6ec2c0 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:20.686561 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2d89040e-2cad-4e8f-8b65-31167b6ec2c0 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:20.687675 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2d89040e-2cad-4e8f-8b65-31167b6ec2c0 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:20.688391 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2d89040e-2cad-4e8f-8b65-31167b6ec2c0 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:20.700059 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-4ca057dd-6953-4e01-8eb5-1377835e932d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:20.700817 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-4ca057dd-6953-4e01-8eb5-1377835e932d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:20.720536 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4ca057dd-6953-4e01-8eb5-1377835e932d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:20.722014 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4ca057dd-6953-4e01-8eb5-1377835e932d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:20.723196 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4ca057dd-6953-4e01-8eb5-1377835e932d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:20.732534 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4ca057dd-6953-4e01-8eb5-1377835e932d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:20.921842 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.objects.instance [None req-4ca057dd-6953-4e01-8eb5-1377835e932d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lazy-loading 'services' on Instance uuid 90d6eef5-1c82-472b-adfb-aeaa1e93d502 {{(pid=107486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 04:57:20.933527 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-2d89040e-2cad-4e8f-8b65-31167b6ec2c0 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:20.945215 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-2d89040e-2cad-4e8f-8b65-31167b6ec2c0 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a" status: 200 len: 1265 microversion: 2.1 time: 0.280124 Aug 07 04:57:20.957478 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 276/601] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:20 2021] GET /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a => generated 1265 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:20.975856 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-ee1e6887-c1cf-44f3-b65f-9806a42d2023 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:20.977355 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-ee1e6887-c1cf-44f3-b65f-9806a42d2023 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 4b54c939-5f03-4579-bb04-d01e73617541] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:20.990496 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ee1e6887-c1cf-44f3-b65f-9806a42d2023 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:20.994699 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ee1e6887-c1cf-44f3-b65f-9806a42d2023 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:20.995522 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ee1e6887-c1cf-44f3-b65f-9806a42d2023 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:20.995961 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ee1e6887-c1cf-44f3-b65f-9806a42d2023 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:21.071165 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-4ca057dd-6953-4e01-8eb5-1377835e932d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "DELETE /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502/os-volume_attachments/f7a65ce4-134f-4ffa-bae8-835758889e7b" status: 202 len: 0 microversion: 2.1 time: 0.378425 Aug 07 04:57:21.072752 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 326/602] 10.222.0.35 () {58 vars in 1416 bytes} [Sat Aug 7 04:57:20 2021] DELETE /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502/os-volume_attachments/f7a65ce4-134f-4ffa-bae8-835758889e7b => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:57:21.086762 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-1e2d489e-a0d6-4b1a-8d6a-d516895ab07f tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:21.093414 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-1e2d489e-a0d6-4b1a-8d6a-d516895ab07f tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:21.113608 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1e2d489e-a0d6-4b1a-8d6a-d516895ab07f tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:21.116962 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1e2d489e-a0d6-4b1a-8d6a-d516895ab07f tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:21.118044 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1e2d489e-a0d6-4b1a-8d6a-d516895ab07f tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:21.130100 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1e2d489e-a0d6-4b1a-8d6a-d516895ab07f tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:21.230601 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-1e2d489e-a0d6-4b1a-8d6a-d516895ab07f tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.151466 Aug 07 04:57:21.232354 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 327/603] 10.222.0.35 () {58 vars in 1302 bytes} [Sat Aug 7 04:57:21 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502/os-volume_attachments => generated 197 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:57:21.238909 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-ee1e6887-c1cf-44f3-b65f-9806a42d2023 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:21.246318 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-94e3c99d-6f2a-4dbf-a9ab-39fa4129cf2f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:57:21.249352 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-ee1e6887-c1cf-44f3-b65f-9806a42d2023 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541" status: 200 len: 1317 microversion: 2.1 time: 0.286492 Aug 07 04:57:21.252906 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 277/604] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:20 2021] GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541 => generated 1317 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:21.261704 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-94e3c99d-6f2a-4dbf-a9ab-39fa4129cf2f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:21.274829 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-94e3c99d-6f2a-4dbf-a9ab-39fa4129cf2f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:21.276313 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-94e3c99d-6f2a-4dbf-a9ab-39fa4129cf2f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:21.277316 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-94e3c99d-6f2a-4dbf-a9ab-39fa4129cf2f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:21.277700 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-94e3c99d-6f2a-4dbf-a9ab-39fa4129cf2f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:21.427282 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-94e3c99d-6f2a-4dbf-a9ab-39fa4129cf2f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 32345 microversion: 2.20 time: 0.186364 Aug 07 04:57:21.428442 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 328/605] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:57:21 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 32345 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:57:21.968116 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-71b3f18d-4a3a-4edb-9d88-d3ed9bd8f1ac tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:21.971887 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-71b3f18d-4a3a-4edb-9d88-d3ed9bd8f1ac tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 9842981a-3233-41c1-a42b-442492d50f3a] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:21.990107 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-71b3f18d-4a3a-4edb-9d88-d3ed9bd8f1ac tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:21.990580 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-71b3f18d-4a3a-4edb-9d88-d3ed9bd8f1ac tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:21.993455 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-71b3f18d-4a3a-4edb-9d88-d3ed9bd8f1ac tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:21.994745 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-71b3f18d-4a3a-4edb-9d88-d3ed9bd8f1ac tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:22.152665 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-71b3f18d-4a3a-4edb-9d88-d3ed9bd8f1ac tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:22.161289 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-71b3f18d-4a3a-4edb-9d88-d3ed9bd8f1ac tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a" status: 200 len: 1265 microversion: 2.1 time: 0.202238 Aug 07 04:57:22.169195 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 278/606] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:21 2021] GET /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a => generated 1265 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:22.242488 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-ee5cba63-b407-40fd-a884-47ba27478436 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:22.244028 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-ee5cba63-b407-40fd-a884-47ba27478436 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:22.250963 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ee5cba63-b407-40fd-a884-47ba27478436 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:22.251410 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ee5cba63-b407-40fd-a884-47ba27478436 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:22.252168 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ee5cba63-b407-40fd-a884-47ba27478436 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:22.252594 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ee5cba63-b407-40fd-a884-47ba27478436 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:22.265974 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-86ed2e32-6c36-41b6-a7bf-f030b3587608 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:22.266588 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-86ed2e32-6c36-41b6-a7bf-f030b3587608 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 4b54c939-5f03-4579-bb04-d01e73617541] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:22.272456 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-86ed2e32-6c36-41b6-a7bf-f030b3587608 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:22.272937 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-86ed2e32-6c36-41b6-a7bf-f030b3587608 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:22.273704 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-86ed2e32-6c36-41b6-a7bf-f030b3587608 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:22.274139 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-86ed2e32-6c36-41b6-a7bf-f030b3587608 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:22.282665 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-ee5cba63-b407-40fd-a884-47ba27478436 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044162 Aug 07 04:57:22.283284 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 329/607] 10.222.0.35 () {58 vars in 1302 bytes} [Sat Aug 7 04:57:22 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:57:22.405416 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-86ed2e32-6c36-41b6-a7bf-f030b3587608 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:22.414904 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-86ed2e32-6c36-41b6-a7bf-f030b3587608 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541" status: 200 len: 1317 microversion: 2.1 time: 0.152410 Aug 07 04:57:22.415753 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 279/608] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:22 2021] GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:57:22.439607 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-56d55fb8-cce3-406f-aae5-6cb05251929b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:57:22.440438 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-56d55fb8-cce3-406f-aae5-6cb05251929b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:22.447531 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-56d55fb8-cce3-406f-aae5-6cb05251929b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:22.448321 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-56d55fb8-cce3-406f-aae5-6cb05251929b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:22.457509 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-56d55fb8-cce3-406f-aae5-6cb05251929b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:22.458049 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-56d55fb8-cce3-406f-aae5-6cb05251929b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:22.778136 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-56d55fb8-cce3-406f-aae5-6cb05251929b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 33153 microversion: 2.20 time: 0.341967 Aug 07 04:57:22.778953 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 330/609] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:57:22 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 33153 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 07 04:57:23.186761 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-56aa1f0a-59a9-46bd-87e3-c126ab3dff6e tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:23.187391 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-56aa1f0a-59a9-46bd-87e3-c126ab3dff6e tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 9842981a-3233-41c1-a42b-442492d50f3a] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:23.205100 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-56aa1f0a-59a9-46bd-87e3-c126ab3dff6e tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:23.205836 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-56aa1f0a-59a9-46bd-87e3-c126ab3dff6e tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:23.206795 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-56aa1f0a-59a9-46bd-87e3-c126ab3dff6e tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:23.207384 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-56aa1f0a-59a9-46bd-87e3-c126ab3dff6e tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:23.294715 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-a7051ebf-511e-496f-862d-1ffb1f548675 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:23.296547 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-a7051ebf-511e-496f-862d-1ffb1f548675 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:23.304203 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a7051ebf-511e-496f-862d-1ffb1f548675 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:23.304942 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a7051ebf-511e-496f-862d-1ffb1f548675 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:23.306759 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a7051ebf-511e-496f-862d-1ffb1f548675 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:23.307474 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a7051ebf-511e-496f-862d-1ffb1f548675 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:23.342243 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-a7051ebf-511e-496f-862d-1ffb1f548675 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051769 Aug 07 04:57:23.347130 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 331/610] 10.222.0.35 () {58 vars in 1302 bytes} [Sat Aug 7 04:57:23 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 04:57:23.350075 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-56aa1f0a-59a9-46bd-87e3-c126ab3dff6e tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:23.359480 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-56aa1f0a-59a9-46bd-87e3-c126ab3dff6e tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a" status: 200 len: 1265 microversion: 2.1 time: 0.176377 Aug 07 04:57:23.360037 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 280/611] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:23 2021] GET /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:57:23.432490 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-9efcc9ef-b2b4-4031-93d9-52734a839172 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:23.433141 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-9efcc9ef-b2b4-4031-93d9-52734a839172 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 4b54c939-5f03-4579-bb04-d01e73617541] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:23.438969 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9efcc9ef-b2b4-4031-93d9-52734a839172 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:23.439420 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9efcc9ef-b2b4-4031-93d9-52734a839172 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:23.440188 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9efcc9ef-b2b4-4031-93d9-52734a839172 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:23.440625 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9efcc9ef-b2b4-4031-93d9-52734a839172 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:23.574724 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-9efcc9ef-b2b4-4031-93d9-52734a839172 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:23.582009 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-9efcc9ef-b2b4-4031-93d9-52734a839172 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541" status: 200 len: 1317 microversion: 2.1 time: 0.153956 Aug 07 04:57:23.582560 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 332/612] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:23 2021] GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:23.810330 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-722c21e1-bc8d-4471-8392-8e16e2f8160a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:57:23.817040 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-722c21e1-bc8d-4471-8392-8e16e2f8160a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:23.836611 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-722c21e1-bc8d-4471-8392-8e16e2f8160a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:23.838690 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-722c21e1-bc8d-4471-8392-8e16e2f8160a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:23.840344 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-722c21e1-bc8d-4471-8392-8e16e2f8160a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:23.841604 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-722c21e1-bc8d-4471-8392-8e16e2f8160a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:23.995666 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-722c21e1-bc8d-4471-8392-8e16e2f8160a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 33615 microversion: 2.20 time: 0.203590 Aug 07 04:57:23.996261 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 281/613] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:57:23 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 33615 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:57:24.267715 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-0826e1f3-812b-4d9f-9b73-6ccc7d8cc019 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2137964504", "imageRef": "ddcf95b5-3ea4-4a61-8f54-4b2feadb8682", "flavorRef": "452"}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:57:24.369801 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-2a106cea-9383-47a3-bf13-2b25f88245c9 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:24.372161 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-2a106cea-9383-47a3-bf13-2b25f88245c9 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:24.390150 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.network.neutron [None req-0826e1f3-812b-4d9f-9b73-6ccc7d8cc019 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] validate_networks() for None {{(pid=107486) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 07 04:57:24.396694 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2a106cea-9383-47a3-bf13-2b25f88245c9 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:24.397426 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2a106cea-9383-47a3-bf13-2b25f88245c9 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:24.401622 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2a106cea-9383-47a3-bf13-2b25f88245c9 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:24.402942 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2a106cea-9383-47a3-bf13-2b25f88245c9 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:24.465255 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-2a106cea-9383-47a3-bf13-2b25f88245c9 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.113724 Aug 07 04:57:24.466906 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 282/614] 10.222.0.35 () {58 vars in 1302 bytes} [Sat Aug 7 04:57:24 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502/os-volume_attachments => generated 25 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 04:57:24.487131 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-bc2b0005-21e3-4ff9-9f6b-2d4e64e52f7c tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:24.488287 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-bc2b0005-21e3-4ff9-9f6b-2d4e64e52f7c tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 9842981a-3233-41c1-a42b-442492d50f3a] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:24.494370 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-bc2b0005-21e3-4ff9-9f6b-2d4e64e52f7c tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:24.495190 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-bc2b0005-21e3-4ff9-9f6b-2d4e64e52f7c tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:24.496130 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-bc2b0005-21e3-4ff9-9f6b-2d4e64e52f7c tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:24.496721 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-bc2b0005-21e3-4ff9-9f6b-2d4e64e52f7c tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:24.709562 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-bc2b0005-21e3-4ff9-9f6b-2d4e64e52f7c tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:24.721756 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-bc2b0005-21e3-4ff9-9f6b-2d4e64e52f7c tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a" status: 200 len: 1265 microversion: 2.1 time: 0.247908 Aug 07 04:57:24.723866 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 283/615] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:24 2021] GET /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a => generated 1265 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:24.732639 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-30c7293f-35ee-483a-93f9-49d844a7ac09 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:24.733611 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-30c7293f-35ee-483a-93f9-49d844a7ac09 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 4b54c939-5f03-4579-bb04-d01e73617541] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:24.740773 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-30c7293f-35ee-483a-93f9-49d844a7ac09 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:24.741687 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-30c7293f-35ee-483a-93f9-49d844a7ac09 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:24.742764 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-30c7293f-35ee-483a-93f9-49d844a7ac09 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:24.744295 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-30c7293f-35ee-483a-93f9-49d844a7ac09 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:24.900428 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-30c7293f-35ee-483a-93f9-49d844a7ac09 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:24.907967 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-30c7293f-35ee-483a-93f9-49d844a7ac09 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541" status: 200 len: 1317 microversion: 2.1 time: 0.182531 Aug 07 04:57:24.908640 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 284/616] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:24 2021] GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541 => generated 1317 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:24.940046 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [req-187252cf-884b-4833-9a94-be5579a9f9da req-43580aa6-9063-4730-b0b8-9c7471599488 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b54c939-5f03-4579-bb04-d01e73617541", "name": "network-vif-plugged", "status": "completed", "tag": "bf23d849-0e24-47ab-ae33-6002837e92e0"}]} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:57:24.941333 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 04:57:24.941333 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: warnings.warn(msg) Aug 07 04:57:24.957261 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-187252cf-884b-4833-9a94-be5579a9f9da req-43580aa6-9063-4730-b0b8-9c7471599488 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:24.957740 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-187252cf-884b-4833-9a94-be5579a9f9da req-43580aa6-9063-4730-b0b8-9c7471599488 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:24.961944 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.virt.hardware [None req-0826e1f3-812b-4d9f-9b73-6ccc7d8cc019 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Flavor limits 0:0:0 {{(pid=107486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 04:57:24.963625 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.virt.hardware [None req-0826e1f3-812b-4d9f-9b73-6ccc7d8cc019 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Image limits 0:0:0 {{(pid=107486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 04:57:24.964592 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.virt.hardware [None req-0826e1f3-812b-4d9f-9b73-6ccc7d8cc019 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Flavor pref 0:0:0 {{(pid=107486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 04:57:24.965241 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.virt.hardware [None req-0826e1f3-812b-4d9f-9b73-6ccc7d8cc019 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Image pref 0:0:0 {{(pid=107486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 04:57:24.966210 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.virt.hardware [None req-0826e1f3-812b-4d9f-9b73-6ccc7d8cc019 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 04:57:24.971553 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.compute.server_external_events [req-187252cf-884b-4833-9a94-be5579a9f9da req-43580aa6-9063-4730-b0b8-9c7471599488 service nova] Creating event network-vif-plugged:bf23d849-0e24-47ab-ae33-6002837e92e0 for instance 4b54c939-5f03-4579-bb04-d01e73617541 on hv-cinder-80374 Aug 07 04:57:24.978640 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0826e1f3-812b-4d9f-9b73-6ccc7d8cc019 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:24.982188 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [req-187252cf-884b-4833-9a94-be5579a9f9da req-43580aa6-9063-4730-b0b8-9c7471599488 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071638 Aug 07 04:57:24.982919 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 285/617] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 04:57:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:57:24.986983 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0826e1f3-812b-4d9f-9b73-6ccc7d8cc019 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:24.989876 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0826e1f3-812b-4d9f-9b73-6ccc7d8cc019 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:24.990717 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0826e1f3-812b-4d9f-9b73-6ccc7d8cc019 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:25.010918 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.quota [None req-0826e1f3-812b-4d9f-9b73-6ccc7d8cc019 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Getting quotas for project 1633f3d4cdb2412b9417cf9eccb946c8. Resources: {'ram', 'cores', 'instances'} {{(pid=107486) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 07 04:57:25.014606 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-c254ded1-95a8-488c-8c5d-b28b0da81b95 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:57:25.015642 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-c254ded1-95a8-488c-8c5d-b28b0da81b95 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:25.016345 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.quota [None req-0826e1f3-812b-4d9f-9b73-6ccc7d8cc019 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Getting quotas for user 2e87026256304573bfeeda21a156123a and project 1633f3d4cdb2412b9417cf9eccb946c8. Resources: {'ram', 'cores', 'instances'} {{(pid=107486) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 07 04:57:25.024106 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c254ded1-95a8-488c-8c5d-b28b0da81b95 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:25.025405 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c254ded1-95a8-488c-8c5d-b28b0da81b95 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:25.026430 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c254ded1-95a8-488c-8c5d-b28b0da81b95 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:25.027010 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c254ded1-95a8-488c-8c5d-b28b0da81b95 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:25.036158 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-0826e1f3-812b-4d9f-9b73-6ccc7d8cc019 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Going to run 1 instances... {{(pid=107486) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 07 04:57:25.041597 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-0826e1f3-812b-4d9f-9b73-6ccc7d8cc019 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] [instance: b8079113-c152-4a13-a741-dbdc2cc01843] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ddcf95b5-3ea4-4a61-8f54-4b2feadb8682',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107486) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 07 04:57:25.110324 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-0826e1f3-812b-4d9f-9b73-6ccc7d8cc019 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.848186 Aug 07 04:57:25.113165 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 333/618] 10.222.0.35 () {60 vars in 1147 bytes} [Sat Aug 7 04:57:24 2021] POST /compute/v2.1/servers => generated 380 bytes in 852 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 04:57:25.123011 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-14227e5c-bfb5-47a9-acad-585abface585 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:25.123629 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-14227e5c-bfb5-47a9-acad-585abface585 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] [instance: b8079113-c152-4a13-a741-dbdc2cc01843] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:25.179956 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-c254ded1-95a8-488c-8c5d-b28b0da81b95 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 34588 microversion: 2.20 time: 0.171138 Aug 07 04:57:25.183908 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 286/619] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:57:25 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 34588 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 07 04:57:25.199350 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-14227e5c-bfb5-47a9-acad-585abface585 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e87026256304573bfeeda21a156123a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1633f3d4cdb2412b9417cf9eccb946c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:25.208426 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-14227e5c-bfb5-47a9-acad-585abface585 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] 10.222.0.35 "GET /compute/v2.1/servers/b8079113-c152-4a13-a741-dbdc2cc01843" status: 200 len: 1215 microversion: 2.1 time: 0.091112 Aug 07 04:57:25.212877 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 334/620] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:25 2021] GET /compute/v2.1/servers/b8079113-c152-4a13-a741-dbdc2cc01843 => generated 1215 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:57:25.748045 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-514f536c-82f8-46ec-82b8-0bf917a2fcae tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:25.749386 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-514f536c-82f8-46ec-82b8-0bf917a2fcae tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 9842981a-3233-41c1-a42b-442492d50f3a] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:25.761720 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-514f536c-82f8-46ec-82b8-0bf917a2fcae tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:25.762541 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-514f536c-82f8-46ec-82b8-0bf917a2fcae tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:25.763890 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-514f536c-82f8-46ec-82b8-0bf917a2fcae tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:25.764776 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-514f536c-82f8-46ec-82b8-0bf917a2fcae tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:25.924976 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-cc66150c-af0e-47df-a4b1-4103064eb021 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:25.925714 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-cc66150c-af0e-47df-a4b1-4103064eb021 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 4b54c939-5f03-4579-bb04-d01e73617541] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:25.939644 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-cc66150c-af0e-47df-a4b1-4103064eb021 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:25.940126 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-cc66150c-af0e-47df-a4b1-4103064eb021 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:25.943844 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-514f536c-82f8-46ec-82b8-0bf917a2fcae tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:25.952886 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-514f536c-82f8-46ec-82b8-0bf917a2fcae tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a" status: 200 len: 1265 microversion: 2.1 time: 0.211828 Aug 07 04:57:25.953465 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 287/621] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:25 2021] GET /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a => generated 1265 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:25.962838 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-cc66150c-af0e-47df-a4b1-4103064eb021 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:25.964096 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-cc66150c-af0e-47df-a4b1-4103064eb021 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:26.107865 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-cc66150c-af0e-47df-a4b1-4103064eb021 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:26.115161 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-cc66150c-af0e-47df-a4b1-4103064eb021 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541" status: 200 len: 1317 microversion: 2.1 time: 0.194472 Aug 07 04:57:26.115739 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 335/622] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:25 2021] GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541 => generated 1317 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:57:26.193269 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-552a71de-85f4-4b29-a5d3-b03c36194e99 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:57:26.194694 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-552a71de-85f4-4b29-a5d3-b03c36194e99 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:26.201826 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-552a71de-85f4-4b29-a5d3-b03c36194e99 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:26.202277 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-552a71de-85f4-4b29-a5d3-b03c36194e99 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:26.203048 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-552a71de-85f4-4b29-a5d3-b03c36194e99 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:26.203484 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-552a71de-85f4-4b29-a5d3-b03c36194e99 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:26.233844 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-224ce0f4-6115-48e5-95f7-8fbb8e431900 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:26.236429 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-224ce0f4-6115-48e5-95f7-8fbb8e431900 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] [instance: b8079113-c152-4a13-a741-dbdc2cc01843] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:26.247926 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-224ce0f4-6115-48e5-95f7-8fbb8e431900 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:26.249295 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-224ce0f4-6115-48e5-95f7-8fbb8e431900 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:26.250401 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-224ce0f4-6115-48e5-95f7-8fbb8e431900 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:26.252517 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-224ce0f4-6115-48e5-95f7-8fbb8e431900 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:26.317933 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-224ce0f4-6115-48e5-95f7-8fbb8e431900 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e87026256304573bfeeda21a156123a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1633f3d4cdb2412b9417cf9eccb946c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:26.326626 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-224ce0f4-6115-48e5-95f7-8fbb8e431900 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] 10.222.0.35 "GET /compute/v2.1/servers/b8079113-c152-4a13-a741-dbdc2cc01843" status: 200 len: 1211 microversion: 2.1 time: 0.103659 Aug 07 04:57:26.327189 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 336/623] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:26 2021] GET /compute/v2.1/servers/b8079113-c152-4a13-a741-dbdc2cc01843 => generated 1211 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:26.376924 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-552a71de-85f4-4b29-a5d3-b03c36194e99 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 35204 microversion: 2.20 time: 0.186639 Aug 07 04:57:26.379120 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 288/624] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:57:26 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 35204 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:57:26.976923 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-1b425ba4-8d81-4eae-b37c-c0e22f9d7352 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:26.980327 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-1b425ba4-8d81-4eae-b37c-c0e22f9d7352 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 9842981a-3233-41c1-a42b-442492d50f3a] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:26.996174 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1b425ba4-8d81-4eae-b37c-c0e22f9d7352 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:26.997158 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1b425ba4-8d81-4eae-b37c-c0e22f9d7352 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:26.998437 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1b425ba4-8d81-4eae-b37c-c0e22f9d7352 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:27.001672 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1b425ba4-8d81-4eae-b37c-c0e22f9d7352 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:27.036289 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-53f5e239-22f7-4dc2-9fdf-ee5a5c12e9e8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:27.041270 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-53f5e239-22f7-4dc2-9fdf-ee5a5c12e9e8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:27.051375 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-53f5e239-22f7-4dc2-9fdf-ee5a5c12e9e8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:27.052303 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-53f5e239-22f7-4dc2-9fdf-ee5a5c12e9e8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:27.053555 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-53f5e239-22f7-4dc2-9fdf-ee5a5c12e9e8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:27.054294 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-53f5e239-22f7-4dc2-9fdf-ee5a5c12e9e8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:27.083644 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-53f5e239-22f7-4dc2-9fdf-ee5a5c12e9e8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Going to try to terminate instance {{(pid=107485) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 07 04:57:27.331361 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-53f5e239-22f7-4dc2-9fdf-ee5a5c12e9e8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "DELETE /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 204 len: 0 microversion: 2.1 time: 0.296435 Aug 07 04:57:27.337087 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 289/625] 10.222.0.35 () {58 vars in 1239 bytes} [Sat Aug 7 04:57:27 2021] DELETE /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 04:57:27.348680 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-193da389-d712-42be-93c4-01bd4f269681 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:27.352698 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-193da389-d712-42be-93c4-01bd4f269681 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 4b54c939-5f03-4579-bb04-d01e73617541] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:27.362556 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-193da389-d712-42be-93c4-01bd4f269681 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:27.367317 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-193da389-d712-42be-93c4-01bd4f269681 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:27.369510 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-193da389-d712-42be-93c4-01bd4f269681 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:27.370042 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-193da389-d712-42be-93c4-01bd4f269681 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:27.409824 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-1b425ba4-8d81-4eae-b37c-c0e22f9d7352 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:27.419189 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-1b425ba4-8d81-4eae-b37c-c0e22f9d7352 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a" status: 200 len: 1265 microversion: 2.1 time: 0.451907 Aug 07 04:57:27.421462 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 337/626] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:26 2021] GET /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a => generated 1265 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:27.428338 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-27866ca0-711f-40db-9380-9eb3135da7f5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:27.448030 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-27866ca0-711f-40db-9380-9eb3135da7f5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:27.468304 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-27866ca0-711f-40db-9380-9eb3135da7f5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:27.469096 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-27866ca0-711f-40db-9380-9eb3135da7f5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:27.469884 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-27866ca0-711f-40db-9380-9eb3135da7f5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:27.470313 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-27866ca0-711f-40db-9380-9eb3135da7f5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:27.577037 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-193da389-d712-42be-93c4-01bd4f269681 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:27.587807 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-193da389-d712-42be-93c4-01bd4f269681 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541" status: 200 len: 1317 microversion: 2.1 time: 0.244293 Aug 07 04:57:27.589620 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 290/627] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:27 2021] GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541 => generated 1317 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:27.610644 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-fb0182a8-fecb-4b59-b6a7-7acd3a51d115 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:27.619110 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-fb0182a8-fecb-4b59-b6a7-7acd3a51d115 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] [instance: b8079113-c152-4a13-a741-dbdc2cc01843] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:27.631675 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-fb0182a8-fecb-4b59-b6a7-7acd3a51d115 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:27.632117 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-fb0182a8-fecb-4b59-b6a7-7acd3a51d115 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:27.634827 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-fb0182a8-fecb-4b59-b6a7-7acd3a51d115 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:27.636781 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-fb0182a8-fecb-4b59-b6a7-7acd3a51d115 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:27.781474 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-fb0182a8-fecb-4b59-b6a7-7acd3a51d115 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e87026256304573bfeeda21a156123a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1633f3d4cdb2412b9417cf9eccb946c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:27.793219 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-fb0182a8-fecb-4b59-b6a7-7acd3a51d115 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] 10.222.0.35 "GET /compute/v2.1/servers/b8079113-c152-4a13-a741-dbdc2cc01843" status: 200 len: 1273 microversion: 2.1 time: 0.200303 Aug 07 04:57:27.799731 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-27866ca0-711f-40db-9380-9eb3135da7f5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:27.802752 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 291/628] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:27 2021] GET /compute/v2.1/servers/b8079113-c152-4a13-a741-dbdc2cc01843 => generated 1273 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:27.809071 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-27866ca0-711f-40db-9380-9eb3135da7f5 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1509 microversion: 2.1 time: 0.386351 Aug 07 04:57:27.812742 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-4d356296-8379-4ea6-9c20-a6819a9f3c48 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:57:27.813697 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-4d356296-8379-4ea6-9c20-a6819a9f3c48 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:27.814220 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 338/629] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:27 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1509 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:27.825656 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4d356296-8379-4ea6-9c20-a6819a9f3c48 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:27.829678 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4d356296-8379-4ea6-9c20-a6819a9f3c48 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:27.831397 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4d356296-8379-4ea6-9c20-a6819a9f3c48 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:27.851051 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4d356296-8379-4ea6-9c20-a6819a9f3c48 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:28.157413 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-4d356296-8379-4ea6-9c20-a6819a9f3c48 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 36436 microversion: 2.20 time: 0.352651 Aug 07 04:57:28.161764 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 292/630] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:57:27 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 36436 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:57:28.441832 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-d877dbbe-017d-4200-ae2a-c50981c0c9c5 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:28.443121 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-d877dbbe-017d-4200-ae2a-c50981c0c9c5 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 9842981a-3233-41c1-a42b-442492d50f3a] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:28.451292 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d877dbbe-017d-4200-ae2a-c50981c0c9c5 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:28.452040 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d877dbbe-017d-4200-ae2a-c50981c0c9c5 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:28.453140 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d877dbbe-017d-4200-ae2a-c50981c0c9c5 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:28.453723 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d877dbbe-017d-4200-ae2a-c50981c0c9c5 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:28.604848 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-2c7a3744-fb3c-489e-b42c-7157d0460b4d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:28.605820 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-2c7a3744-fb3c-489e-b42c-7157d0460b4d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 4b54c939-5f03-4579-bb04-d01e73617541] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:28.625047 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2c7a3744-fb3c-489e-b42c-7157d0460b4d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:28.625836 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2c7a3744-fb3c-489e-b42c-7157d0460b4d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:28.627391 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2c7a3744-fb3c-489e-b42c-7157d0460b4d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:28.628519 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2c7a3744-fb3c-489e-b42c-7157d0460b4d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:28.732398 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-d877dbbe-017d-4200-ae2a-c50981c0c9c5 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:28.740344 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-d877dbbe-017d-4200-ae2a-c50981c0c9c5 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a" status: 200 len: 1265 microversion: 2.1 time: 0.304261 Aug 07 04:57:28.743218 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 339/631] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:28 2021] GET /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a => generated 1265 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:28.781835 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-2c7a3744-fb3c-489e-b42c-7157d0460b4d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:28.789499 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-2c7a3744-fb3c-489e-b42c-7157d0460b4d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541" status: 200 len: 1504 microversion: 2.1 time: 0.189161 Aug 07 04:57:28.797138 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 293/632] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:28 2021] GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541 => generated 1504 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:57:28.810657 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-690094e9-f494-49fe-a0b5-73e3a4d2ad1b tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:28.811337 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-690094e9-f494-49fe-a0b5-73e3a4d2ad1b tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] [instance: b8079113-c152-4a13-a741-dbdc2cc01843] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:28.817906 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-690094e9-f494-49fe-a0b5-73e3a4d2ad1b tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:28.818357 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-690094e9-f494-49fe-a0b5-73e3a4d2ad1b tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:28.819142 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-690094e9-f494-49fe-a0b5-73e3a4d2ad1b tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:28.819642 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-690094e9-f494-49fe-a0b5-73e3a4d2ad1b tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:28.826350 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-b34f0fba-ab39-4777-92dd-109e5efcfa81 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:28.826954 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-b34f0fba-ab39-4777-92dd-109e5efcfa81 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:28.834672 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b34f0fba-ab39-4777-92dd-109e5efcfa81 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:28.835075 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b34f0fba-ab39-4777-92dd-109e5efcfa81 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:28.836141 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b34f0fba-ab39-4777-92dd-109e5efcfa81 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:28.836577 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b34f0fba-ab39-4777-92dd-109e5efcfa81 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:29.031495 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-b34f0fba-ab39-4777-92dd-109e5efcfa81 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:29.048084 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-b34f0fba-ab39-4777-92dd-109e5efcfa81 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1509 microversion: 2.1 time: 0.225265 Aug 07 04:57:29.048677 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 294/633] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:28 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1509 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:57:29.174807 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-d05a3f52-d1d1-4bdf-ba4f-ce8527a45a32 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:57:29.176480 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-d05a3f52-d1d1-4bdf-ba4f-ce8527a45a32 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:29.191219 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d05a3f52-d1d1-4bdf-ba4f-ce8527a45a32 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:29.191665 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d05a3f52-d1d1-4bdf-ba4f-ce8527a45a32 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:29.192932 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d05a3f52-d1d1-4bdf-ba4f-ce8527a45a32 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:29.193367 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d05a3f52-d1d1-4bdf-ba4f-ce8527a45a32 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:29.402886 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-690094e9-f494-49fe-a0b5-73e3a4d2ad1b tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e87026256304573bfeeda21a156123a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1633f3d4cdb2412b9417cf9eccb946c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:29.410360 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-690094e9-f494-49fe-a0b5-73e3a4d2ad1b tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] 10.222.0.35 "GET /compute/v2.1/servers/b8079113-c152-4a13-a741-dbdc2cc01843" status: 200 len: 1315 microversion: 2.1 time: 0.604551 Aug 07 04:57:29.410986 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 340/634] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:28 2021] GET /compute/v2.1/servers/b8079113-c152-4a13-a741-dbdc2cc01843 => generated 1315 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:29.428582 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-d05a3f52-d1d1-4bdf-ba4f-ce8527a45a32 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 37104 microversion: 2.20 time: 0.256993 Aug 07 04:57:29.430541 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 295/635] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:57:29 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 37104 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 07 04:57:29.760089 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-f524b465-79a9-4380-b53c-b8a132544587 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:29.760707 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-f524b465-79a9-4380-b53c-b8a132544587 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 9842981a-3233-41c1-a42b-442492d50f3a] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:29.767210 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f524b465-79a9-4380-b53c-b8a132544587 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:29.767627 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f524b465-79a9-4380-b53c-b8a132544587 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:29.768770 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f524b465-79a9-4380-b53c-b8a132544587 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:29.769535 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f524b465-79a9-4380-b53c-b8a132544587 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:30.050106 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-f524b465-79a9-4380-b53c-b8a132544587 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:30.062091 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-f524b465-79a9-4380-b53c-b8a132544587 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a" status: 200 len: 1265 microversion: 2.1 time: 0.306262 Aug 07 04:57:30.063571 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 341/636] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:29 2021] GET /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a => generated 1265 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:30.066602 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-201dba19-d098-4263-9ecd-f29ca1344f82 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:30.067560 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-201dba19-d098-4263-9ecd-f29ca1344f82 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:30.077512 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-201dba19-d098-4263-9ecd-f29ca1344f82 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:30.077973 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-201dba19-d098-4263-9ecd-f29ca1344f82 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:30.078779 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-201dba19-d098-4263-9ecd-f29ca1344f82 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:30.079363 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-201dba19-d098-4263-9ecd-f29ca1344f82 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:30.239223 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-201dba19-d098-4263-9ecd-f29ca1344f82 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:30.249987 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-201dba19-d098-4263-9ecd-f29ca1344f82 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1509 microversion: 2.1 time: 0.189461 Aug 07 04:57:30.250545 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 296/637] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:30 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1509 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:57:30.283371 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [req-9d1e746b-8341-47d8-b8f6-d3861d2c4b02 req-11b4cc4a-0ccc-49b8-9389-19c92fe8c203 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8079113-c152-4a13-a741-dbdc2cc01843", "tag": "c11cc320-a262-4982-92a9-a07cac9ca25f"}]} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:57:30.285590 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 04:57:30.285590 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: warnings.warn(msg) Aug 07 04:57:30.300566 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-9d1e746b-8341-47d8-b8f6-d3861d2c4b02 req-11b4cc4a-0ccc-49b8-9389-19c92fe8c203 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:30.301290 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-9d1e746b-8341-47d8-b8f6-d3861d2c4b02 req-11b4cc4a-0ccc-49b8-9389-19c92fe8c203 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:30.325208 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-ebcd45a5-23c3-447e-b284-9ec81c7f3b14 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "78dbee81-3be4-4723-9b69-e63b7e3ccd6b"}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:57:30.326024 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.compute.server_external_events [req-9d1e746b-8341-47d8-b8f6-d3861d2c4b02 req-11b4cc4a-0ccc-49b8-9389-19c92fe8c203 service nova] Creating event network-changed:c11cc320-a262-4982-92a9-a07cac9ca25f for instance b8079113-c152-4a13-a741-dbdc2cc01843 on hv-cinder-80374 Aug 07 04:57:30.326277 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-ebcd45a5-23c3-447e-b284-9ec81c7f3b14 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 4b54c939-5f03-4579-bb04-d01e73617541] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:30.333484 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ebcd45a5-23c3-447e-b284-9ec81c7f3b14 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:30.333936 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ebcd45a5-23c3-447e-b284-9ec81c7f3b14 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:30.334365 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [req-9d1e746b-8341-47d8-b8f6-d3861d2c4b02 req-11b4cc4a-0ccc-49b8-9389-19c92fe8c203 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063812 Aug 07 04:57:30.334735 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ebcd45a5-23c3-447e-b284-9ec81c7f3b14 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:30.334992 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 342/638] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 04:57:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:57:30.335176 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ebcd45a5-23c3-447e-b284-9ec81c7f3b14 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:30.430319 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-c15ea065-431f-4435-af03-c5f05cfc8ed3 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:30.431920 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-c15ea065-431f-4435-af03-c5f05cfc8ed3 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] [instance: b8079113-c152-4a13-a741-dbdc2cc01843] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:30.447286 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c15ea065-431f-4435-af03-c5f05cfc8ed3 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:30.447737 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c15ea065-431f-4435-af03-c5f05cfc8ed3 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:30.448532 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c15ea065-431f-4435-af03-c5f05cfc8ed3 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:30.448999 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c15ea065-431f-4435-af03-c5f05cfc8ed3 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:30.743918 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-ebcd45a5-23c3-447e-b284-9ec81c7f3b14 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "POST /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.421544 Aug 07 04:57:30.744609 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 297/639] 10.222.0.35 () {60 vars in 1323 bytes} [Sat Aug 7 04:57:30 2021] POST /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541/os-volume_attachments => generated 194 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:57:30.778565 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-3abe2ebd-d82c-47c0-9d53-11341a0dc910 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:57:30.786984 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-3abe2ebd-d82c-47c0-9d53-11341a0dc910 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:30.799774 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3abe2ebd-d82c-47c0-9d53-11341a0dc910 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:30.800890 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3abe2ebd-d82c-47c0-9d53-11341a0dc910 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:30.804150 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3abe2ebd-d82c-47c0-9d53-11341a0dc910 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:30.807826 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3abe2ebd-d82c-47c0-9d53-11341a0dc910 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:30.826269 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-c15ea065-431f-4435-af03-c5f05cfc8ed3 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e87026256304573bfeeda21a156123a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1633f3d4cdb2412b9417cf9eccb946c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:30.833663 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-c15ea065-431f-4435-af03-c5f05cfc8ed3 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] 10.222.0.35 "GET /compute/v2.1/servers/b8079113-c152-4a13-a741-dbdc2cc01843" status: 200 len: 1315 microversion: 2.1 time: 0.407556 Aug 07 04:57:30.838844 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 343/640] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:30 2021] GET /compute/v2.1/servers/b8079113-c152-4a13-a741-dbdc2cc01843 => generated 1315 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:57:30.856236 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [req-ecdcf2fc-a5fb-4b2d-a50e-4d929335f786 req-b0761a43-57e3-4e0d-b13c-7596f9a91b6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9842981a-3233-41c1-a42b-442492d50f3a", "name": "network-vif-plugged", "status": "completed", "tag": "8625acb3-8bac-4659-9273-7a1a3bc30dc6"}]} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:57:30.859278 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 04:57:30.859278 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: warnings.warn(msg) Aug 07 04:57:30.871510 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-ecdcf2fc-a5fb-4b2d-a50e-4d929335f786 req-b0761a43-57e3-4e0d-b13c-7596f9a91b6e service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:30.872300 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-ecdcf2fc-a5fb-4b2d-a50e-4d929335f786 req-b0761a43-57e3-4e0d-b13c-7596f9a91b6e service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:30.888636 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.compute.server_external_events [req-ecdcf2fc-a5fb-4b2d-a50e-4d929335f786 req-b0761a43-57e3-4e0d-b13c-7596f9a91b6e service nova] Creating event network-vif-plugged:8625acb3-8bac-4659-9273-7a1a3bc30dc6 for instance 9842981a-3233-41c1-a42b-442492d50f3a on hv-cinder-80374 Aug 07 04:57:30.896596 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [req-ecdcf2fc-a5fb-4b2d-a50e-4d929335f786 req-b0761a43-57e3-4e0d-b13c-7596f9a91b6e service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056342 Aug 07 04:57:30.898484 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 344/641] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 04:57:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:57:31.053235 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-3abe2ebd-d82c-47c0-9d53-11341a0dc910 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 38181 microversion: 2.20 time: 0.287019 Aug 07 04:57:31.056401 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 298/642] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:57:30 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 38181 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:57:31.090647 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-119daba3-dd01-4758-a8df-91ea243741df tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:31.092416 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-119daba3-dd01-4758-a8df-91ea243741df tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 9842981a-3233-41c1-a42b-442492d50f3a] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:31.100333 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-119daba3-dd01-4758-a8df-91ea243741df tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:31.100782 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-119daba3-dd01-4758-a8df-91ea243741df tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:31.103265 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-119daba3-dd01-4758-a8df-91ea243741df tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:31.104610 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-119daba3-dd01-4758-a8df-91ea243741df tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:31.267638 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-ff0d78b2-bdb3-4532-89f0-63d877126597 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:31.268345 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-ff0d78b2-bdb3-4532-89f0-63d877126597 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:31.275476 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ff0d78b2-bdb3-4532-89f0-63d877126597 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:31.275916 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ff0d78b2-bdb3-4532-89f0-63d877126597 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:31.276746 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ff0d78b2-bdb3-4532-89f0-63d877126597 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:31.277216 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ff0d78b2-bdb3-4532-89f0-63d877126597 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:31.395325 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-119daba3-dd01-4758-a8df-91ea243741df tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:31.408766 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-119daba3-dd01-4758-a8df-91ea243741df tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a" status: 200 len: 1265 microversion: 2.1 time: 0.331892 Aug 07 04:57:31.409873 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 345/643] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:31 2021] GET /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a => generated 1265 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:57:31.466666 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-ff0d78b2-bdb3-4532-89f0-63d877126597 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:31.477539 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-ff0d78b2-bdb3-4532-89f0-63d877126597 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1509 microversion: 2.1 time: 0.211232 Aug 07 04:57:31.477539 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 299/644] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:31 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1509 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:57:31.855564 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-6c471619-1c60-45aa-8c4d-1d4a062a7c5f tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:31.856269 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-6c471619-1c60-45aa-8c4d-1d4a062a7c5f tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] [instance: b8079113-c152-4a13-a741-dbdc2cc01843] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:31.863572 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6c471619-1c60-45aa-8c4d-1d4a062a7c5f tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:31.864018 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6c471619-1c60-45aa-8c4d-1d4a062a7c5f tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:31.864816 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6c471619-1c60-45aa-8c4d-1d4a062a7c5f tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:31.865419 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6c471619-1c60-45aa-8c4d-1d4a062a7c5f tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:32.066629 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-35fab3d7-3da2-4cf5-bc17-aaf2e68bf014 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:57:32.067552 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-35fab3d7-3da2-4cf5-bc17-aaf2e68bf014 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:32.075710 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-35fab3d7-3da2-4cf5-bc17-aaf2e68bf014 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:32.076158 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-35fab3d7-3da2-4cf5-bc17-aaf2e68bf014 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:32.076993 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-35fab3d7-3da2-4cf5-bc17-aaf2e68bf014 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:32.077433 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-35fab3d7-3da2-4cf5-bc17-aaf2e68bf014 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:32.405661 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-35fab3d7-3da2-4cf5-bc17-aaf2e68bf014 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 38186 microversion: 2.20 time: 0.342576 Aug 07 04:57:32.407267 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 300/645] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:57:32 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 38186 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:57:32.426251 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-ff21e089-7bfa-4dcb-a0a9-a5c058c4e7b8 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:32.427656 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-ff21e089-7bfa-4dcb-a0a9-a5c058c4e7b8 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 9842981a-3233-41c1-a42b-442492d50f3a] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:32.435565 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ff21e089-7bfa-4dcb-a0a9-a5c058c4e7b8 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:32.436034 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ff21e089-7bfa-4dcb-a0a9-a5c058c4e7b8 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:32.442447 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ff21e089-7bfa-4dcb-a0a9-a5c058c4e7b8 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:32.444280 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-6c471619-1c60-45aa-8c4d-1d4a062a7c5f tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e87026256304573bfeeda21a156123a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1633f3d4cdb2412b9417cf9eccb946c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:32.444920 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ff21e089-7bfa-4dcb-a0a9-a5c058c4e7b8 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:32.457645 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-6c471619-1c60-45aa-8c4d-1d4a062a7c5f tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] 10.222.0.35 "GET /compute/v2.1/servers/b8079113-c152-4a13-a741-dbdc2cc01843" status: 200 len: 1315 microversion: 2.1 time: 0.605863 Aug 07 04:57:32.469079 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 346/646] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:31 2021] GET /compute/v2.1/servers/b8079113-c152-4a13-a741-dbdc2cc01843 => generated 1315 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:32.498173 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-525d8d94-6db7-4123-800c-2bfeb0574cbc tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:32.499124 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-525d8d94-6db7-4123-800c-2bfeb0574cbc tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:32.506222 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-525d8d94-6db7-4123-800c-2bfeb0574cbc tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:32.507124 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-525d8d94-6db7-4123-800c-2bfeb0574cbc tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:32.508182 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-525d8d94-6db7-4123-800c-2bfeb0574cbc tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:32.510088 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-525d8d94-6db7-4123-800c-2bfeb0574cbc tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:32.807348 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-525d8d94-6db7-4123-800c-2bfeb0574cbc tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:32.814931 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-525d8d94-6db7-4123-800c-2bfeb0574cbc tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1509 microversion: 2.1 time: 0.322751 Aug 07 04:57:32.815499 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 347/647] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:32 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1509 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:32.844090 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-ff21e089-7bfa-4dcb-a0a9-a5c058c4e7b8 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:32.854404 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-ff21e089-7bfa-4dcb-a0a9-a5c058c4e7b8 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a" status: 200 len: 1265 microversion: 2.1 time: 0.431571 Aug 07 04:57:32.856106 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 301/648] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:32 2021] GET /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a => generated 1265 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:33.381994 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [req-44407d8e-3562-4f4c-b967-869304aec5bb req-547eb177-e43e-494d-a3a6-e260b526cb31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7660d04d-3aad-49e0-b8a5-12820fcb4d66", "name": "network-vif-deleted", "tag": "8385bf57-9f35-4380-8238-83874f21430a"}]} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:57:33.385189 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 04:57:33.385189 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: warnings.warn(msg) Aug 07 04:57:33.397335 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-44407d8e-3562-4f4c-b967-869304aec5bb req-547eb177-e43e-494d-a3a6-e260b526cb31 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:33.399994 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-44407d8e-3562-4f4c-b967-869304aec5bb req-547eb177-e43e-494d-a3a6-e260b526cb31 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:33.418992 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.compute.server_external_events [req-44407d8e-3562-4f4c-b967-869304aec5bb req-547eb177-e43e-494d-a3a6-e260b526cb31 service nova] Creating event network-vif-deleted:8385bf57-9f35-4380-8238-83874f21430a for instance 7660d04d-3aad-49e0-b8a5-12820fcb4d66 on hv-cinder-80374 Aug 07 04:57:33.424469 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-5e39811b-6553-4ec9-a662-eb9b506460da tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:57:33.426015 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-5e39811b-6553-4ec9-a662-eb9b506460da tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:33.431570 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [req-44407d8e-3562-4f4c-b967-869304aec5bb req-547eb177-e43e-494d-a3a6-e260b526cb31 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051275 Aug 07 04:57:33.434776 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 348/649] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 04:57:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:57:33.437872 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5e39811b-6553-4ec9-a662-eb9b506460da tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:33.438374 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5e39811b-6553-4ec9-a662-eb9b506460da tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:33.457183 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5e39811b-6553-4ec9-a662-eb9b506460da tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:33.457772 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5e39811b-6553-4ec9-a662-eb9b506460da tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:33.475545 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-0ff4a41d-d616-4418-8668-f315381b258b tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:33.476497 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-0ff4a41d-d616-4418-8668-f315381b258b tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] [instance: b8079113-c152-4a13-a741-dbdc2cc01843] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:33.488849 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0ff4a41d-d616-4418-8668-f315381b258b tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:33.489656 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0ff4a41d-d616-4418-8668-f315381b258b tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:33.492575 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0ff4a41d-d616-4418-8668-f315381b258b tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:33.496028 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0ff4a41d-d616-4418-8668-f315381b258b tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:33.683115 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-5e39811b-6553-4ec9-a662-eb9b506460da tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 200 len: 38322 microversion: 2.20 time: 0.268766 Aug 07 04:57:33.683758 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 302/650] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:57:33 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 38322 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:57:33.695692 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-fbe4785a-0a09-46da-a23c-1cdd8b2343da tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:33.701682 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-fbe4785a-0a09-46da-a23c-1cdd8b2343da tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:33.715507 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-fbe4785a-0a09-46da-a23c-1cdd8b2343da tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:33.715966 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-fbe4785a-0a09-46da-a23c-1cdd8b2343da tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:33.716756 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-fbe4785a-0a09-46da-a23c-1cdd8b2343da tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:33.719746 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-0ff4a41d-d616-4418-8668-f315381b258b tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e87026256304573bfeeda21a156123a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1633f3d4cdb2412b9417cf9eccb946c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:33.720010 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-fbe4785a-0a09-46da-a23c-1cdd8b2343da tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:33.733036 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-0ff4a41d-d616-4418-8668-f315381b258b tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] 10.222.0.35 "GET /compute/v2.1/servers/b8079113-c152-4a13-a741-dbdc2cc01843" status: 200 len: 1315 microversion: 2.1 time: 0.261249 Aug 07 04:57:33.734289 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 349/651] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:33 2021] GET /compute/v2.1/servers/b8079113-c152-4a13-a741-dbdc2cc01843 => generated 1315 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:57:33.758249 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-fbe4785a-0a09-46da-a23c-1cdd8b2343da tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/ips" status: 200 len: 152 microversion: 2.20 time: 0.067793 Aug 07 04:57:33.759808 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 303/652] 10.222.0.35 () {60 vars in 1289 bytes} [Sat Aug 7 04:57:33 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/ips => generated 152 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 04:57:33.832685 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-dd2d6fee-0dd1-4973-94d1-12844d16515a tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:33.833657 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-dd2d6fee-0dd1-4973-94d1-12844d16515a tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:33.842908 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-dd2d6fee-0dd1-4973-94d1-12844d16515a tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:33.843360 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-dd2d6fee-0dd1-4973-94d1-12844d16515a tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:33.846403 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-dd2d6fee-0dd1-4973-94d1-12844d16515a tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:33.849418 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-dd2d6fee-0dd1-4973-94d1-12844d16515a tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:33.871285 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-7120a3a3-5d2a-4a63-9ad9-0fae197f52bd tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:33.872175 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-7120a3a3-5d2a-4a63-9ad9-0fae197f52bd tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 9842981a-3233-41c1-a42b-442492d50f3a] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:33.885233 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7120a3a3-5d2a-4a63-9ad9-0fae197f52bd tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:33.885771 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7120a3a3-5d2a-4a63-9ad9-0fae197f52bd tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:33.886588 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7120a3a3-5d2a-4a63-9ad9-0fae197f52bd tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:33.887036 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7120a3a3-5d2a-4a63-9ad9-0fae197f52bd tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:33.907349 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-dd2d6fee-0dd1-4973-94d1-12844d16515a tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:33.908121 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-dd2d6fee-0dd1-4973-94d1-12844d16515a tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:33.908828 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.objects.instance [None req-dd2d6fee-0dd1-4973-94d1-12844d16515a tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lazy-loading 'fault' on Instance uuid 7660d04d-3aad-49e0-b8a5-12820fcb4d66 {{(pid=107486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 04:57:33.957697 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-dd2d6fee-0dd1-4973-94d1-12844d16515a tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:33.967556 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-dd2d6fee-0dd1-4973-94d1-12844d16515a tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 200 len: 1312 microversion: 2.1 time: 0.139344 Aug 07 04:57:33.979274 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 350/653] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:33 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 1312 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:34.203382 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-7120a3a3-5d2a-4a63-9ad9-0fae197f52bd tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:34.224041 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-7120a3a3-5d2a-4a63-9ad9-0fae197f52bd tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a" status: 200 len: 1265 microversion: 2.1 time: 0.356374 Aug 07 04:57:34.224708 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 304/654] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:33 2021] GET /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a => generated 1265 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:57:34.756664 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-4adb8a45-971e-4af5-8153-7dc14ada0bbf tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:34.761266 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-4adb8a45-971e-4af5-8153-7dc14ada0bbf tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] [instance: b8079113-c152-4a13-a741-dbdc2cc01843] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:34.772583 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4adb8a45-971e-4af5-8153-7dc14ada0bbf tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:34.775692 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4adb8a45-971e-4af5-8153-7dc14ada0bbf tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:34.776523 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4adb8a45-971e-4af5-8153-7dc14ada0bbf tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:34.777309 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4adb8a45-971e-4af5-8153-7dc14ada0bbf tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:34.985816 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-a65c6ec7-337a-4398-baa8-fdbe983964de tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:34.987048 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-a65c6ec7-337a-4398-baa8-fdbe983964de tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 7660d04d-3aad-49e0-b8a5-12820fcb4d66] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:35.006716 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a65c6ec7-337a-4398-baa8-fdbe983964de tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:35.007463 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a65c6ec7-337a-4398-baa8-fdbe983964de tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:35.008437 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a65c6ec7-337a-4398-baa8-fdbe983964de tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:35.009210 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a65c6ec7-337a-4398-baa8-fdbe983964de tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:35.014632 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-4adb8a45-971e-4af5-8153-7dc14ada0bbf tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e87026256304573bfeeda21a156123a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1633f3d4cdb2412b9417cf9eccb946c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:35.026795 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-4adb8a45-971e-4af5-8153-7dc14ada0bbf tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] 10.222.0.35 "GET /compute/v2.1/servers/b8079113-c152-4a13-a741-dbdc2cc01843" status: 200 len: 1315 microversion: 2.1 time: 0.279738 Aug 07 04:57:35.029842 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 351/655] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:34 2021] GET /compute/v2.1/servers/b8079113-c152-4a13-a741-dbdc2cc01843 => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:35.032963 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.wsgi [None req-a65c6ec7-337a-4398-baa8-fdbe983964de tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] HTTP exception thrown: Instance 7660d04d-3aad-49e0-b8a5-12820fcb4d66 could not be found. Aug 07 04:57:35.033600 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-a65c6ec7-337a-4398-baa8-fdbe983964de tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Returning 404 to user: Instance 7660d04d-3aad-49e0-b8a5-12820fcb4d66 could not be found. {{(pid=107485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 07 04:57:35.034468 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-a65c6ec7-337a-4398-baa8-fdbe983964de tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66" status: 404 len: 111 microversion: 2.1 time: 0.052392 Aug 07 04:57:35.043064 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 305/656] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:34 2021] GET /compute/v2.1/servers/7660d04d-3aad-49e0-b8a5-12820fcb4d66 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 04:57:35.046905 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-5dcb173b-746c-451b-bbfc-5528eb0afdd8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:35.047442 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-5dcb173b-746c-451b-bbfc-5528eb0afdd8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:35.062706 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5dcb173b-746c-451b-bbfc-5528eb0afdd8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:35.063072 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5dcb173b-746c-451b-bbfc-5528eb0afdd8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:35.065577 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5dcb173b-746c-451b-bbfc-5528eb0afdd8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:35.068172 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5dcb173b-746c-451b-bbfc-5528eb0afdd8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:35.123590 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-5dcb173b-746c-451b-bbfc-5528eb0afdd8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Going to try to terminate instance {{(pid=107486) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 07 04:57:35.249249 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-972a73b9-cd0a-4c7b-8c4b-3a96ff161a90 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:35.253478 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-972a73b9-cd0a-4c7b-8c4b-3a96ff161a90 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 9842981a-3233-41c1-a42b-442492d50f3a] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:35.264436 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-972a73b9-cd0a-4c7b-8c4b-3a96ff161a90 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:35.269806 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-972a73b9-cd0a-4c7b-8c4b-3a96ff161a90 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:35.271735 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-972a73b9-cd0a-4c7b-8c4b-3a96ff161a90 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:35.273727 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-972a73b9-cd0a-4c7b-8c4b-3a96ff161a90 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:35.310039 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-5dcb173b-746c-451b-bbfc-5528eb0afdd8 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "DELETE /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 204 len: 0 microversion: 2.1 time: 0.269981 Aug 07 04:57:35.313734 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 352/657] 10.222.0.35 () {58 vars in 1239 bytes} [Sat Aug 7 04:57:35 2021] DELETE /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 04:57:35.324919 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-9f36022e-1174-4c9a-bd9b-26bb5353e0a9 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:35.325513 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-9f36022e-1174-4c9a-bd9b-26bb5353e0a9 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:35.347247 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9f36022e-1174-4c9a-bd9b-26bb5353e0a9 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:35.347706 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9f36022e-1174-4c9a-bd9b-26bb5353e0a9 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:35.348503 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9f36022e-1174-4c9a-bd9b-26bb5353e0a9 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:35.349121 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9f36022e-1174-4c9a-bd9b-26bb5353e0a9 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:35.534951 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-972a73b9-cd0a-4c7b-8c4b-3a96ff161a90 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:35.552147 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-972a73b9-cd0a-4c7b-8c4b-3a96ff161a90 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a" status: 200 len: 1452 microversion: 2.1 time: 0.314643 Aug 07 04:57:35.552741 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 306/658] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:35 2021] GET /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a => generated 1452 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:35.566785 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-77fc02a8-7d19-481a-903e-61d38bb68d2d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:35.567221 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-77fc02a8-7d19-481a-903e-61d38bb68d2d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 4b54c939-5f03-4579-bb04-d01e73617541] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:35.577823 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-77fc02a8-7d19-481a-903e-61d38bb68d2d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:35.578269 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-77fc02a8-7d19-481a-903e-61d38bb68d2d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:35.579053 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-77fc02a8-7d19-481a-903e-61d38bb68d2d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:35.579473 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-77fc02a8-7d19-481a-903e-61d38bb68d2d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:35.600490 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-9f36022e-1174-4c9a-bd9b-26bb5353e0a9 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:35.610604 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-9f36022e-1174-4c9a-bd9b-26bb5353e0a9 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1522 microversion: 2.1 time: 0.295689 Aug 07 04:57:35.612590 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 353/659] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:35 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1522 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:35.618009 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-4dc236c0-81bb-4dda-8285-65c2fd5097b7 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:35.619146 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-4dc236c0-81bb-4dda-8285-65c2fd5097b7 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 9842981a-3233-41c1-a42b-442492d50f3a] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:35.625893 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4dc236c0-81bb-4dda-8285-65c2fd5097b7 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:35.626349 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4dc236c0-81bb-4dda-8285-65c2fd5097b7 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:35.627130 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4dc236c0-81bb-4dda-8285-65c2fd5097b7 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:35.627737 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4dc236c0-81bb-4dda-8285-65c2fd5097b7 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:35.698744 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.objects.instance [None req-77fc02a8-7d19-481a-903e-61d38bb68d2d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lazy-loading 'services' on Instance uuid 4b54c939-5f03-4579-bb04-d01e73617541 {{(pid=107485) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 04:57:35.822134 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-4dc236c0-81bb-4dda-8285-65c2fd5097b7 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:35.830858 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-4dc236c0-81bb-4dda-8285-65c2fd5097b7 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a" status: 200 len: 1452 microversion: 2.1 time: 0.216882 Aug 07 04:57:35.831438 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 354/660] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:35 2021] GET /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a => generated 1452 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:35.866625 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-77fc02a8-7d19-481a-903e-61d38bb68d2d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "DELETE /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541/os-volume_attachments/78dbee81-3be4-4723-9b69-e63b7e3ccd6b" status: 202 len: 0 microversion: 2.1 time: 0.303595 Aug 07 04:57:35.873034 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 307/661] 10.222.0.35 () {58 vars in 1416 bytes} [Sat Aug 7 04:57:35 2021] DELETE /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541/os-volume_attachments/78dbee81-3be4-4723-9b69-e63b7e3ccd6b => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:57:35.882155 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-aaab55e4-b65a-4500-8bda-a4a0c9d55c9d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:35.883145 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-aaab55e4-b65a-4500-8bda-a4a0c9d55c9d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 4b54c939-5f03-4579-bb04-d01e73617541] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:35.898867 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-aaab55e4-b65a-4500-8bda-a4a0c9d55c9d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:35.900277 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-aaab55e4-b65a-4500-8bda-a4a0c9d55c9d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:35.901616 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-aaab55e4-b65a-4500-8bda-a4a0c9d55c9d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:35.902214 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-aaab55e4-b65a-4500-8bda-a4a0c9d55c9d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:35.975125 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-aaab55e4-b65a-4500-8bda-a4a0c9d55c9d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100924 Aug 07 04:57:35.975893 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 355/662] 10.222.0.35 () {58 vars in 1302 bytes} [Sat Aug 7 04:57:35 2021] GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:57:36.045086 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-511c1311-aa4c-46bb-ba06-5b0d65ecc8d8 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:36.045777 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-511c1311-aa4c-46bb-ba06-5b0d65ecc8d8 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] [instance: b8079113-c152-4a13-a741-dbdc2cc01843] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:36.059502 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-511c1311-aa4c-46bb-ba06-5b0d65ecc8d8 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:36.059954 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-511c1311-aa4c-46bb-ba06-5b0d65ecc8d8 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:36.060733 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-511c1311-aa4c-46bb-ba06-5b0d65ecc8d8 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:36.061192 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-511c1311-aa4c-46bb-ba06-5b0d65ecc8d8 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:36.282835 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-511c1311-aa4c-46bb-ba06-5b0d65ecc8d8 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e87026256304573bfeeda21a156123a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1633f3d4cdb2412b9417cf9eccb946c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:36.292706 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-511c1311-aa4c-46bb-ba06-5b0d65ecc8d8 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] 10.222.0.35 "GET /compute/v2.1/servers/b8079113-c152-4a13-a741-dbdc2cc01843" status: 200 len: 1315 microversion: 2.1 time: 0.251560 Aug 07 04:57:36.293415 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 308/663] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:36 2021] GET /compute/v2.1/servers/b8079113-c152-4a13-a741-dbdc2cc01843 => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:36.630267 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-437d2f4e-e104-4167-b6e2-c1fd7da27058 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:36.630893 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-437d2f4e-e104-4167-b6e2-c1fd7da27058 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:36.641848 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-437d2f4e-e104-4167-b6e2-c1fd7da27058 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:36.641848 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-437d2f4e-e104-4167-b6e2-c1fd7da27058 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:36.642303 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-437d2f4e-e104-4167-b6e2-c1fd7da27058 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:36.642545 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-437d2f4e-e104-4167-b6e2-c1fd7da27058 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:36.703793 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-4323a9ca-edef-4daa-90fa-d62a8f91d9b1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:57:36.704575 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-4323a9ca-edef-4daa-90fa-d62a8f91d9b1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:36.712438 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4323a9ca-edef-4daa-90fa-d62a8f91d9b1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:36.716913 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4323a9ca-edef-4daa-90fa-d62a8f91d9b1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:36.719636 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4323a9ca-edef-4daa-90fa-d62a8f91d9b1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:36.720096 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4323a9ca-edef-4daa-90fa-d62a8f91d9b1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:36.793969 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.objects.instance [None req-4323a9ca-edef-4daa-90fa-d62a8f91d9b1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lazy-loading 'flavor' on Instance uuid 431857b6-a453-44f0-829c-00ed610d5fc2 {{(pid=107485) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 04:57:37.052364 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-437d2f4e-e104-4167-b6e2-c1fd7da27058 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:37.063464 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-437d2f4e-e104-4167-b6e2-c1fd7da27058 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1522 microversion: 2.1 time: 0.438259 Aug 07 04:57:37.064780 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 356/664] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:36 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1522 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:37.077819 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-32ab62ca-7652-4f0e-9034-ff83962edf0b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:37.079122 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-32ab62ca-7652-4f0e-9034-ff83962edf0b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 4b54c939-5f03-4579-bb04-d01e73617541] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:37.091426 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-32ab62ca-7652-4f0e-9034-ff83962edf0b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:37.097304 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-32ab62ca-7652-4f0e-9034-ff83962edf0b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:37.098465 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-32ab62ca-7652-4f0e-9034-ff83962edf0b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:37.099196 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-32ab62ca-7652-4f0e-9034-ff83962edf0b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:37.136265 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-32ab62ca-7652-4f0e-9034-ff83962edf0b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069988 Aug 07 04:57:37.137338 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 357/665] 10.222.0.35 () {58 vars in 1302 bytes} [Sat Aug 7 04:57:37 2021] GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:57:37.314217 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-af9e826f-9efa-4e6e-8db9-778ad24f87c5 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:37.315744 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-af9e826f-9efa-4e6e-8db9-778ad24f87c5 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] [instance: b8079113-c152-4a13-a741-dbdc2cc01843] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:37.332360 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-af9e826f-9efa-4e6e-8db9-778ad24f87c5 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:37.333315 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-af9e826f-9efa-4e6e-8db9-778ad24f87c5 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:37.334869 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-af9e826f-9efa-4e6e-8db9-778ad24f87c5 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:37.335692 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-af9e826f-9efa-4e6e-8db9-778ad24f87c5 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:37.397495 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-4323a9ca-edef-4daa-90fa-d62a8f91d9b1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 202 len: 0 microversion: 2.20 time: 0.697557 Aug 07 04:57:37.402056 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 309/666] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:57:36 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 0 bytes in 703 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 07 04:57:37.420652 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-b71a578a-92fc-43e6-917f-d65f6d830505 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:37.421753 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-b71a578a-92fc-43e6-917f-d65f6d830505 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:37.428275 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b71a578a-92fc-43e6-917f-d65f6d830505 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:37.428875 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b71a578a-92fc-43e6-917f-d65f6d830505 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:37.430074 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b71a578a-92fc-43e6-917f-d65f6d830505 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:37.430803 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b71a578a-92fc-43e6-917f-d65f6d830505 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:37.699669 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-af9e826f-9efa-4e6e-8db9-778ad24f87c5 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e87026256304573bfeeda21a156123a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1633f3d4cdb2412b9417cf9eccb946c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:37.707209 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-af9e826f-9efa-4e6e-8db9-778ad24f87c5 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] 10.222.0.35 "GET /compute/v2.1/servers/b8079113-c152-4a13-a741-dbdc2cc01843" status: 200 len: 1315 microversion: 2.1 time: 0.400119 Aug 07 04:57:37.707874 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 358/667] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:37 2021] GET /compute/v2.1/servers/b8079113-c152-4a13-a741-dbdc2cc01843 => generated 1315 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:37.764498 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-b71a578a-92fc-43e6-917f-d65f6d830505 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:37.775110 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-b71a578a-92fc-43e6-917f-d65f6d830505 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:37.778528 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-b71a578a-92fc-43e6-917f-d65f6d830505 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:37.779700 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-b71a578a-92fc-43e6-917f-d65f6d830505 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1720 microversion: 2.20 time: 0.371205 Aug 07 04:57:37.780427 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 310/668] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:57:37 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1720 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:57:38.083962 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-18faaf1a-224b-444b-949d-379a2b6111ef tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:38.086348 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-18faaf1a-224b-444b-949d-379a2b6111ef tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:38.094660 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-18faaf1a-224b-444b-949d-379a2b6111ef tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:38.097025 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-18faaf1a-224b-444b-949d-379a2b6111ef tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:38.098853 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-18faaf1a-224b-444b-949d-379a2b6111ef tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:38.100387 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-18faaf1a-224b-444b-949d-379a2b6111ef tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:38.151755 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-8d37ec70-73ad-4b8d-b8c6-194ad1a86e1e tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:38.152509 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-8d37ec70-73ad-4b8d-b8c6-194ad1a86e1e tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 4b54c939-5f03-4579-bb04-d01e73617541] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:38.159773 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8d37ec70-73ad-4b8d-b8c6-194ad1a86e1e tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:38.160470 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8d37ec70-73ad-4b8d-b8c6-194ad1a86e1e tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:38.161497 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8d37ec70-73ad-4b8d-b8c6-194ad1a86e1e tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:38.162799 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8d37ec70-73ad-4b8d-b8c6-194ad1a86e1e tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:38.202482 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-8d37ec70-73ad-4b8d-b8c6-194ad1a86e1e tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055813 Aug 07 04:57:38.203682 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 311/669] 10.222.0.35 () {58 vars in 1302 bytes} [Sat Aug 7 04:57:38 2021] GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:57:38.503736 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-18faaf1a-224b-444b-949d-379a2b6111ef tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:38.512237 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-18faaf1a-224b-444b-949d-379a2b6111ef tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1522 microversion: 2.1 time: 0.434402 Aug 07 04:57:38.521612 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 359/670] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:38 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1522 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:38.728048 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-5bc0dd26-7173-430f-9b0c-6eb47d622b19 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:38.730862 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-5bc0dd26-7173-430f-9b0c-6eb47d622b19 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] [instance: b8079113-c152-4a13-a741-dbdc2cc01843] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:38.737398 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5bc0dd26-7173-430f-9b0c-6eb47d622b19 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:38.738172 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5bc0dd26-7173-430f-9b0c-6eb47d622b19 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:38.739124 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5bc0dd26-7173-430f-9b0c-6eb47d622b19 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:38.739709 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5bc0dd26-7173-430f-9b0c-6eb47d622b19 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:38.798728 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-0980a6ff-4b7d-413b-9b51-a4fe1c028eac tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:38.799321 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-0980a6ff-4b7d-413b-9b51-a4fe1c028eac tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:38.817261 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0980a6ff-4b7d-413b-9b51-a4fe1c028eac tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:38.818001 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0980a6ff-4b7d-413b-9b51-a4fe1c028eac tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:38.819281 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0980a6ff-4b7d-413b-9b51-a4fe1c028eac tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:38.819926 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0980a6ff-4b7d-413b-9b51-a4fe1c028eac tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:38.998940 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-5bc0dd26-7173-430f-9b0c-6eb47d622b19 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e87026256304573bfeeda21a156123a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1633f3d4cdb2412b9417cf9eccb946c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:39.007231 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-5bc0dd26-7173-430f-9b0c-6eb47d622b19 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] 10.222.0.35 "GET /compute/v2.1/servers/b8079113-c152-4a13-a741-dbdc2cc01843" status: 200 len: 1315 microversion: 2.1 time: 0.285437 Aug 07 04:57:39.008600 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 312/671] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:38 2021] GET /compute/v2.1/servers/b8079113-c152-4a13-a741-dbdc2cc01843 => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:39.014348 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [req-560dbddd-29e5-40dc-b18d-94da567670f1 req-aa103f73-95d1-487f-ad76-51ee457e77c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9842981a-3233-41c1-a42b-442492d50f3a", "tag": "8625acb3-8bac-4659-9273-7a1a3bc30dc6"}]} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:57:39.016115 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 04:57:39.016115 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: warnings.warn(msg) Aug 07 04:57:39.023609 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-560dbddd-29e5-40dc-b18d-94da567670f1 req-aa103f73-95d1-487f-ad76-51ee457e77c7 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:39.024731 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-560dbddd-29e5-40dc-b18d-94da567670f1 req-aa103f73-95d1-487f-ad76-51ee457e77c7 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:39.037880 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.compute.server_external_events [req-560dbddd-29e5-40dc-b18d-94da567670f1 req-aa103f73-95d1-487f-ad76-51ee457e77c7 service nova] Creating event network-changed:8625acb3-8bac-4659-9273-7a1a3bc30dc6 for instance 9842981a-3233-41c1-a42b-442492d50f3a on hv-cinder-80374 Aug 07 04:57:39.043993 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [req-560dbddd-29e5-40dc-b18d-94da567670f1 req-aa103f73-95d1-487f-ad76-51ee457e77c7 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033276 Aug 07 04:57:39.048781 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 313/672] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 04:57:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:57:39.071697 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-0980a6ff-4b7d-413b-9b51-a4fe1c028eac tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:39.084243 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-0980a6ff-4b7d-413b-9b51-a4fe1c028eac tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:39.086871 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-0980a6ff-4b7d-413b-9b51-a4fe1c028eac tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:39.088593 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-0980a6ff-4b7d-413b-9b51-a4fe1c028eac tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1720 microversion: 2.20 time: 0.293643 Aug 07 04:57:39.089543 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 360/673] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:57:38 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1720 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 04:57:39.218939 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-c7382ac0-ff71-4838-8ea1-d35169fc8961 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:39.222032 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-c7382ac0-ff71-4838-8ea1-d35169fc8961 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 4b54c939-5f03-4579-bb04-d01e73617541] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:39.230472 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c7382ac0-ff71-4838-8ea1-d35169fc8961 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:39.231190 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c7382ac0-ff71-4838-8ea1-d35169fc8961 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:39.232241 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c7382ac0-ff71-4838-8ea1-d35169fc8961 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:39.232823 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c7382ac0-ff71-4838-8ea1-d35169fc8961 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:39.288821 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-c7382ac0-ff71-4838-8ea1-d35169fc8961 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076559 Aug 07 04:57:39.293262 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 314/674] 10.222.0.35 () {58 vars in 1302 bytes} [Sat Aug 7 04:57:39 2021] GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:57:39.532154 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-8da12be9-1e38-4a47-bf95-40c821870550 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:39.533578 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-8da12be9-1e38-4a47-bf95-40c821870550 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:39.543982 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8da12be9-1e38-4a47-bf95-40c821870550 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:39.544985 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8da12be9-1e38-4a47-bf95-40c821870550 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:39.547334 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8da12be9-1e38-4a47-bf95-40c821870550 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:39.548006 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8da12be9-1e38-4a47-bf95-40c821870550 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:39.820049 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-8da12be9-1e38-4a47-bf95-40c821870550 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:39.859752 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-8da12be9-1e38-4a47-bf95-40c821870550 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1522 microversion: 2.1 time: 0.332709 Aug 07 04:57:39.860574 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 361/675] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:39 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1522 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:57:40.023236 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-bcbf66ba-f225-43c4-8aff-c5fe234d2d75 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:40.023858 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-bcbf66ba-f225-43c4-8aff-c5fe234d2d75 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] [instance: b8079113-c152-4a13-a741-dbdc2cc01843] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:40.030367 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-bcbf66ba-f225-43c4-8aff-c5fe234d2d75 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:40.030821 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-bcbf66ba-f225-43c4-8aff-c5fe234d2d75 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:40.031614 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-bcbf66ba-f225-43c4-8aff-c5fe234d2d75 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:40.032051 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-bcbf66ba-f225-43c4-8aff-c5fe234d2d75 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:40.108425 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-115caf94-96cf-460a-b443-8186f9ef3f24 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:40.109174 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-115caf94-96cf-460a-b443-8186f9ef3f24 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:40.116871 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-115caf94-96cf-460a-b443-8186f9ef3f24 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:40.117325 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-115caf94-96cf-460a-b443-8186f9ef3f24 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:40.118448 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-115caf94-96cf-460a-b443-8186f9ef3f24 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:40.118898 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-115caf94-96cf-460a-b443-8186f9ef3f24 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:40.221930 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-bcbf66ba-f225-43c4-8aff-c5fe234d2d75 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e87026256304573bfeeda21a156123a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1633f3d4cdb2412b9417cf9eccb946c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:40.230090 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-bcbf66ba-f225-43c4-8aff-c5fe234d2d75 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] 10.222.0.35 "GET /compute/v2.1/servers/b8079113-c152-4a13-a741-dbdc2cc01843" status: 200 len: 1315 microversion: 2.1 time: 0.210443 Aug 07 04:57:40.244185 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 315/676] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:40 2021] GET /compute/v2.1/servers/b8079113-c152-4a13-a741-dbdc2cc01843 => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:40.303356 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-316be287-915a-4947-8c4f-5b4c607aad11 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:40.304281 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-316be287-915a-4947-8c4f-5b4c607aad11 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 4b54c939-5f03-4579-bb04-d01e73617541] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:40.315827 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-316be287-915a-4947-8c4f-5b4c607aad11 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:40.316294 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-316be287-915a-4947-8c4f-5b4c607aad11 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:40.319188 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-316be287-915a-4947-8c4f-5b4c607aad11 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:40.319652 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-316be287-915a-4947-8c4f-5b4c607aad11 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:40.373303 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-115caf94-96cf-460a-b443-8186f9ef3f24 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:40.383729 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-115caf94-96cf-460a-b443-8186f9ef3f24 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:40.385558 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-316be287-915a-4947-8c4f-5b4c607aad11 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087643 Aug 07 04:57:40.386707 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 316/677] 10.222.0.35 () {58 vars in 1302 bytes} [Sat Aug 7 04:57:40 2021] GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 04:57:40.396590 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-115caf94-96cf-460a-b443-8186f9ef3f24 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:40.398507 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-115caf94-96cf-460a-b443-8186f9ef3f24 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1720 microversion: 2.20 time: 0.293945 Aug 07 04:57:40.400085 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 362/678] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:57:40 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1720 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:57:40.877907 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-a62b0445-d34b-49f6-a7b0-6c152aa086d7 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:40.878632 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-a62b0445-d34b-49f6-a7b0-6c152aa086d7 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:40.886111 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a62b0445-d34b-49f6-a7b0-6c152aa086d7 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:40.888516 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a62b0445-d34b-49f6-a7b0-6c152aa086d7 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:40.889658 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a62b0445-d34b-49f6-a7b0-6c152aa086d7 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:40.890589 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a62b0445-d34b-49f6-a7b0-6c152aa086d7 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:41.136219 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-a62b0445-d34b-49f6-a7b0-6c152aa086d7 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:41.146901 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-a62b0445-d34b-49f6-a7b0-6c152aa086d7 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1522 microversion: 2.1 time: 0.272564 Aug 07 04:57:41.153759 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 317/679] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:40 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:41.256316 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-1f8ce97d-b520-4e70-baed-86e4df628880 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:41.256999 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-1f8ce97d-b520-4e70-baed-86e4df628880 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] [instance: b8079113-c152-4a13-a741-dbdc2cc01843] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:41.271150 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1f8ce97d-b520-4e70-baed-86e4df628880 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:41.272238 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1f8ce97d-b520-4e70-baed-86e4df628880 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:41.273371 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1f8ce97d-b520-4e70-baed-86e4df628880 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:41.274335 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1f8ce97d-b520-4e70-baed-86e4df628880 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:41.397462 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-1ad40f14-678d-403e-8151-def25c360c8a tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:41.398566 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-1ad40f14-678d-403e-8151-def25c360c8a tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 4b54c939-5f03-4579-bb04-d01e73617541] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:41.404420 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1ad40f14-678d-403e-8151-def25c360c8a tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:41.404945 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1ad40f14-678d-403e-8151-def25c360c8a tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:41.405921 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1ad40f14-678d-403e-8151-def25c360c8a tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:41.406506 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1ad40f14-678d-403e-8151-def25c360c8a tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:41.443913 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-1f8ce97d-b520-4e70-baed-86e4df628880 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e87026256304573bfeeda21a156123a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1633f3d4cdb2412b9417cf9eccb946c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:41.451962 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-1f8ce97d-b520-4e70-baed-86e4df628880 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] 10.222.0.35 "GET /compute/v2.1/servers/b8079113-c152-4a13-a741-dbdc2cc01843" status: 200 len: 1315 microversion: 2.1 time: 0.207833 Aug 07 04:57:41.454333 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 363/680] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:41 2021] GET /compute/v2.1/servers/b8079113-c152-4a13-a741-dbdc2cc01843 => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:41.463715 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-ed515e8e-9243-4e6e-b546-94d68491341d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:41.466273 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-ed515e8e-9243-4e6e-b546-94d68491341d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:41.476686 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-1ad40f14-678d-403e-8151-def25c360c8a tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082697 Aug 07 04:57:41.479597 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ed515e8e-9243-4e6e-b546-94d68491341d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:41.482513 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 318/681] 10.222.0.35 () {58 vars in 1302 bytes} [Sat Aug 7 04:57:41 2021] GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:57:41.485826 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ed515e8e-9243-4e6e-b546-94d68491341d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:41.486670 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ed515e8e-9243-4e6e-b546-94d68491341d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:41.487102 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ed515e8e-9243-4e6e-b546-94d68491341d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:41.683502 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-ed515e8e-9243-4e6e-b546-94d68491341d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:41.693116 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-ed515e8e-9243-4e6e-b546-94d68491341d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:41.698597 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-ed515e8e-9243-4e6e-b546-94d68491341d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:41.703104 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-ed515e8e-9243-4e6e-b546-94d68491341d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1720 microversion: 2.20 time: 0.245045 Aug 07 04:57:41.703848 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 364/682] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:57:41 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1720 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:57:42.171823 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-646d4373-8304-407f-ae63-c273683662c0 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:42.173081 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-646d4373-8304-407f-ae63-c273683662c0 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:42.178954 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-646d4373-8304-407f-ae63-c273683662c0 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:42.179667 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-646d4373-8304-407f-ae63-c273683662c0 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:42.181159 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-646d4373-8304-407f-ae63-c273683662c0 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:42.181783 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-646d4373-8304-407f-ae63-c273683662c0 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:42.428249 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-646d4373-8304-407f-ae63-c273683662c0 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:42.442219 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-646d4373-8304-407f-ae63-c273683662c0 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1522 microversion: 2.1 time: 0.272597 Aug 07 04:57:42.443408 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 319/683] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:42 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:42.471789 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-085040ae-c212-4248-882e-5fa06616bc2d tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:42.472402 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-085040ae-c212-4248-882e-5fa06616bc2d tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] [instance: b8079113-c152-4a13-a741-dbdc2cc01843] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:42.486125 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-085040ae-c212-4248-882e-5fa06616bc2d tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:42.487094 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-085040ae-c212-4248-882e-5fa06616bc2d tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:42.487896 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-085040ae-c212-4248-882e-5fa06616bc2d tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:42.488337 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-085040ae-c212-4248-882e-5fa06616bc2d tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:42.490717 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-70d8e971-6ffa-4d46-8406-ee91a4382879 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:42.492278 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-70d8e971-6ffa-4d46-8406-ee91a4382879 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 4b54c939-5f03-4579-bb04-d01e73617541] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:42.499260 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-70d8e971-6ffa-4d46-8406-ee91a4382879 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:42.500023 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-70d8e971-6ffa-4d46-8406-ee91a4382879 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:42.501740 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-70d8e971-6ffa-4d46-8406-ee91a4382879 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:42.502413 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-70d8e971-6ffa-4d46-8406-ee91a4382879 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:42.550445 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-70d8e971-6ffa-4d46-8406-ee91a4382879 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064266 Aug 07 04:57:42.551778 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 320/684] 10.222.0.35 () {58 vars in 1302 bytes} [Sat Aug 7 04:57:42 2021] GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 04:57:42.674629 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-085040ae-c212-4248-882e-5fa06616bc2d tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e87026256304573bfeeda21a156123a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1633f3d4cdb2412b9417cf9eccb946c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:42.683760 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-085040ae-c212-4248-882e-5fa06616bc2d tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] 10.222.0.35 "GET /compute/v2.1/servers/b8079113-c152-4a13-a741-dbdc2cc01843" status: 200 len: 1315 microversion: 2.1 time: 0.216026 Aug 07 04:57:42.694597 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 365/685] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:42 2021] GET /compute/v2.1/servers/b8079113-c152-4a13-a741-dbdc2cc01843 => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:42.725828 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-915f8461-e341-4e6a-a018-d3f08229707d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:42.726560 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-915f8461-e341-4e6a-a018-d3f08229707d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:42.732887 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-915f8461-e341-4e6a-a018-d3f08229707d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:42.733664 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-915f8461-e341-4e6a-a018-d3f08229707d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:42.734456 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-915f8461-e341-4e6a-a018-d3f08229707d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:42.734899 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-915f8461-e341-4e6a-a018-d3f08229707d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:42.885136 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-915f8461-e341-4e6a-a018-d3f08229707d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:42.893263 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-915f8461-e341-4e6a-a018-d3f08229707d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:42.900110 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-915f8461-e341-4e6a-a018-d3f08229707d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:42.901344 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-915f8461-e341-4e6a-a018-d3f08229707d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1720 microversion: 2.20 time: 0.179914 Aug 07 04:57:42.901910 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 321/686] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:57:42 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1720 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:57:43.122634 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-782bcbf5-a214-4c0c-8906-c05c7b9bea5b tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Action: 'create', calling method: .version_select at 0x7f75fa738f70>, body: {"keypair": {"name": "tempest-TestShelveInstance-516936065"}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:57:43.155868 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.quota [None req-782bcbf5-a214-4c0c-8906-c05c7b9bea5b tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Getting quotas for project 9874042788a343ec976046e4394fa45e. Resources: {'key_pairs'} {{(pid=107486) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 07 04:57:43.159814 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.quota [None req-782bcbf5-a214-4c0c-8906-c05c7b9bea5b tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Getting quotas for user 9fec41eb8ba14082b33f628c86fe48c8 and project 9874042788a343ec976046e4394fa45e. Resources: {'key_pairs'} {{(pid=107486) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 07 04:57:43.394464 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.quota [None req-782bcbf5-a214-4c0c-8906-c05c7b9bea5b tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Getting quotas for project 9874042788a343ec976046e4394fa45e. Resources: {'key_pairs'} {{(pid=107486) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 07 04:57:43.400955 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.quota [None req-782bcbf5-a214-4c0c-8906-c05c7b9bea5b tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Getting quotas for user 9fec41eb8ba14082b33f628c86fe48c8 and project 9874042788a343ec976046e4394fa45e. Resources: {'key_pairs'} {{(pid=107486) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 07 04:57:43.418035 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-782bcbf5-a214-4c0c-8906-c05c7b9bea5b tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 2311 microversion: 2.1 time: 0.543328 Aug 07 04:57:43.418682 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 366/687] 10.222.0.35 () {60 vars in 1158 bytes} [Sat Aug 7 04:57:42 2021] POST /compute/v2.1/os-keypairs => generated 2311 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:57:43.460632 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-ff120e5f-4cd0-445a-b3b8-1d684a3a7789 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:43.462057 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-ff120e5f-4cd0-445a-b3b8-1d684a3a7789 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:43.470681 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ff120e5f-4cd0-445a-b3b8-1d684a3a7789 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:43.471473 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ff120e5f-4cd0-445a-b3b8-1d684a3a7789 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:43.472240 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ff120e5f-4cd0-445a-b3b8-1d684a3a7789 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:43.472960 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ff120e5f-4cd0-445a-b3b8-1d684a3a7789 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:43.532048 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [req-86fc601e-15f7-4a2d-855f-2df3d2923514 req-ce27d7ad-b92d-4806-93e8-b125d59eaddd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8079113-c152-4a13-a741-dbdc2cc01843", "name": "network-vif-plugged", "status": "completed", "tag": "c11cc320-a262-4982-92a9-a07cac9ca25f"}]} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:57:43.535479 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 04:57:43.535479 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: warnings.warn(msg) Aug 07 04:57:43.549859 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-86fc601e-15f7-4a2d-855f-2df3d2923514 req-ce27d7ad-b92d-4806-93e8-b125d59eaddd service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:43.563250 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-86fc601e-15f7-4a2d-855f-2df3d2923514 req-ce27d7ad-b92d-4806-93e8-b125d59eaddd service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:43.580477 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.compute.server_external_events [req-86fc601e-15f7-4a2d-855f-2df3d2923514 req-ce27d7ad-b92d-4806-93e8-b125d59eaddd service nova] Creating event network-vif-plugged:c11cc320-a262-4982-92a9-a07cac9ca25f for instance b8079113-c152-4a13-a741-dbdc2cc01843 on hv-cinder-80374 Aug 07 04:57:43.591949 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [req-86fc601e-15f7-4a2d-855f-2df3d2923514 req-ce27d7ad-b92d-4806-93e8-b125d59eaddd service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084087 Aug 07 04:57:43.592981 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 367/688] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 04:57:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:57:43.599724 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-ca8a53ec-26ff-44dd-84ed-7fa41369e468 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:43.601138 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-ca8a53ec-26ff-44dd-84ed-7fa41369e468 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 4b54c939-5f03-4579-bb04-d01e73617541] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:43.608321 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ca8a53ec-26ff-44dd-84ed-7fa41369e468 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:43.609459 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ca8a53ec-26ff-44dd-84ed-7fa41369e468 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:43.610827 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ca8a53ec-26ff-44dd-84ed-7fa41369e468 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:43.611496 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ca8a53ec-26ff-44dd-84ed-7fa41369e468 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:43.652067 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-ca8a53ec-26ff-44dd-84ed-7fa41369e468 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057540 Aug 07 04:57:43.652761 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 368/689] 10.222.0.35 () {58 vars in 1302 bytes} [Sat Aug 7 04:57:43 2021] GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 04:57:43.702811 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-95cf38a4-a99b-4382-a700-b2cbbbc4d0e8 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:43.703431 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-95cf38a4-a99b-4382-a700-b2cbbbc4d0e8 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] [instance: b8079113-c152-4a13-a741-dbdc2cc01843] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:43.714986 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-95cf38a4-a99b-4382-a700-b2cbbbc4d0e8 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:43.715851 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-95cf38a4-a99b-4382-a700-b2cbbbc4d0e8 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:43.716943 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-95cf38a4-a99b-4382-a700-b2cbbbc4d0e8 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:43.717531 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-95cf38a4-a99b-4382-a700-b2cbbbc4d0e8 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:43.736041 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-ff120e5f-4cd0-445a-b3b8-1d684a3a7789 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:43.746939 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-ff120e5f-4cd0-445a-b3b8-1d684a3a7789 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1522 microversion: 2.1 time: 0.290006 Aug 07 04:57:43.747696 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 322/690] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:43 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:43.920831 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-041bf4d7-6419-4e33-ae16-a4ffe27b62f0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:43.921433 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-041bf4d7-6419-4e33-ae16-a4ffe27b62f0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:43.928993 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-041bf4d7-6419-4e33-ae16-a4ffe27b62f0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:43.929774 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-041bf4d7-6419-4e33-ae16-a4ffe27b62f0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:43.932053 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-041bf4d7-6419-4e33-ae16-a4ffe27b62f0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:43.932658 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-041bf4d7-6419-4e33-ae16-a4ffe27b62f0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:44.001181 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-95cf38a4-a99b-4382-a700-b2cbbbc4d0e8 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e87026256304573bfeeda21a156123a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1633f3d4cdb2412b9417cf9eccb946c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:44.008620 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-95cf38a4-a99b-4382-a700-b2cbbbc4d0e8 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] 10.222.0.35 "GET /compute/v2.1/servers/b8079113-c152-4a13-a741-dbdc2cc01843" status: 200 len: 1315 microversion: 2.1 time: 0.309689 Aug 07 04:57:44.009231 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 369/691] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:43 2021] GET /compute/v2.1/servers/b8079113-c152-4a13-a741-dbdc2cc01843 => generated 1315 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:44.127185 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-041bf4d7-6419-4e33-ae16-a4ffe27b62f0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:44.141160 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-041bf4d7-6419-4e33-ae16-a4ffe27b62f0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:44.143143 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-041bf4d7-6419-4e33-ae16-a4ffe27b62f0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:44.144324 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-041bf4d7-6419-4e33-ae16-a4ffe27b62f0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1720 microversion: 2.20 time: 0.227291 Aug 07 04:57:44.144914 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 323/692] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:57:43 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1720 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:57:44.764592 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-2546b241-204a-4d59-bc60-d6f241fd6ccb tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:44.766194 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-2546b241-204a-4d59-bc60-d6f241fd6ccb tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:44.772982 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2546b241-204a-4d59-bc60-d6f241fd6ccb tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:44.773431 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2546b241-204a-4d59-bc60-d6f241fd6ccb tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:44.774909 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2546b241-204a-4d59-bc60-d6f241fd6ccb tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:44.775455 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2546b241-204a-4d59-bc60-d6f241fd6ccb tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:44.910293 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-1529cf0b-d546-494c-8ca7-ea6c11b9f5ea tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:44.910938 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-1529cf0b-d546-494c-8ca7-ea6c11b9f5ea tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 4b54c939-5f03-4579-bb04-d01e73617541] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:44.917828 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1529cf0b-d546-494c-8ca7-ea6c11b9f5ea tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:44.918594 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1529cf0b-d546-494c-8ca7-ea6c11b9f5ea tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:44.919611 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1529cf0b-d546-494c-8ca7-ea6c11b9f5ea tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:44.920256 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1529cf0b-d546-494c-8ca7-ea6c11b9f5ea tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:44.929508 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-2546b241-204a-4d59-bc60-d6f241fd6ccb tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:44.938170 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-2546b241-204a-4d59-bc60-d6f241fd6ccb tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1522 microversion: 2.1 time: 0.177295 Aug 07 04:57:44.948543 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 370/693] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:44 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:44.950732 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-1529cf0b-d546-494c-8ca7-ea6c11b9f5ea tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 4b54c939-5f03-4579-bb04-d01e73617541] Going to try to terminate instance {{(pid=107485) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 07 04:57:45.028336 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-e4cec8d0-c4d9-43ab-974b-272f658160fb tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:45.030118 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-e4cec8d0-c4d9-43ab-974b-272f658160fb tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] [instance: b8079113-c152-4a13-a741-dbdc2cc01843] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:45.035813 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-1529cf0b-d546-494c-8ca7-ea6c11b9f5ea tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "DELETE /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541" status: 204 len: 0 microversion: 2.1 time: 0.128626 Aug 07 04:57:45.036399 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 324/694] 10.222.0.35 () {58 vars in 1239 bytes} [Sat Aug 7 04:57:44 2021] DELETE /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 04:57:45.041472 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e4cec8d0-c4d9-43ab-974b-272f658160fb tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:45.042110 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e4cec8d0-c4d9-43ab-974b-272f658160fb tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:45.043151 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e4cec8d0-c4d9-43ab-974b-272f658160fb tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:45.044434 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e4cec8d0-c4d9-43ab-974b-272f658160fb tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:45.048132 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-6f162323-fa92-48d0-bba9-e4971846ea11 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:45.048866 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-6f162323-fa92-48d0-bba9-e4971846ea11 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 4b54c939-5f03-4579-bb04-d01e73617541] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:45.054584 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6f162323-fa92-48d0-bba9-e4971846ea11 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:45.054994 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6f162323-fa92-48d0-bba9-e4971846ea11 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:45.056047 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6f162323-fa92-48d0-bba9-e4971846ea11 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:45.056486 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6f162323-fa92-48d0-bba9-e4971846ea11 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:45.197430 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-e4cec8d0-c4d9-43ab-974b-272f658160fb tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e87026256304573bfeeda21a156123a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1633f3d4cdb2412b9417cf9eccb946c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:45.205278 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-e4cec8d0-c4d9-43ab-974b-272f658160fb tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] 10.222.0.35 "GET /compute/v2.1/servers/b8079113-c152-4a13-a741-dbdc2cc01843" status: 200 len: 1315 microversion: 2.1 time: 0.183821 Aug 07 04:57:45.215630 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 371/695] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:45 2021] GET /compute/v2.1/servers/b8079113-c152-4a13-a741-dbdc2cc01843 => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:45.220748 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-281e6e3d-4406-493f-a127-18dc75d3f93e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:45.221390 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-281e6e3d-4406-493f-a127-18dc75d3f93e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:45.222294 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-6f162323-fa92-48d0-bba9-e4971846ea11 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:45.228520 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-281e6e3d-4406-493f-a127-18dc75d3f93e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:45.229004 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-281e6e3d-4406-493f-a127-18dc75d3f93e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:45.229781 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-281e6e3d-4406-493f-a127-18dc75d3f93e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:45.230216 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-281e6e3d-4406-493f-a127-18dc75d3f93e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:45.230660 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-6f162323-fa92-48d0-bba9-e4971846ea11 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541" status: 200 len: 1510 microversion: 2.1 time: 0.186455 Aug 07 04:57:45.231243 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 325/696] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:45 2021] GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541 => generated 1510 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:45.356345 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-281e6e3d-4406-493f-a127-18dc75d3f93e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:45.364139 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-281e6e3d-4406-493f-a127-18dc75d3f93e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:45.365644 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-281e6e3d-4406-493f-a127-18dc75d3f93e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:45.366793 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-281e6e3d-4406-493f-a127-18dc75d3f93e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1720 microversion: 2.20 time: 0.150046 Aug 07 04:57:45.367346 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 372/697] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:57:45 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:57:45.955556 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-f2f70b4c-714d-431a-b743-bf2fbeb3b831 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:45.956161 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-f2f70b4c-714d-431a-b743-bf2fbeb3b831 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:45.963193 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f2f70b4c-714d-431a-b743-bf2fbeb3b831 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:45.963643 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f2f70b4c-714d-431a-b743-bf2fbeb3b831 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:45.964415 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f2f70b4c-714d-431a-b743-bf2fbeb3b831 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:45.964864 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f2f70b4c-714d-431a-b743-bf2fbeb3b831 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:46.085604 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-f2f70b4c-714d-431a-b743-bf2fbeb3b831 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:46.094734 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-f2f70b4c-714d-431a-b743-bf2fbeb3b831 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1522 microversion: 2.1 time: 0.143178 Aug 07 04:57:46.095783 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 326/698] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:45 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1522 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:46.236886 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-760d5234-b4b5-45a0-87f4-d4013b20c7ce tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:46.236886 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-760d5234-b4b5-45a0-87f4-d4013b20c7ce tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] [instance: b8079113-c152-4a13-a741-dbdc2cc01843] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:46.236886 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-760d5234-b4b5-45a0-87f4-d4013b20c7ce tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:46.236886 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-760d5234-b4b5-45a0-87f4-d4013b20c7ce tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:46.237912 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-760d5234-b4b5-45a0-87f4-d4013b20c7ce tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:46.237912 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-760d5234-b4b5-45a0-87f4-d4013b20c7ce tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:46.251535 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-476e26d3-0da6-4874-b549-fca70ac6401b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:46.261414 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-476e26d3-0da6-4874-b549-fca70ac6401b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 4b54c939-5f03-4579-bb04-d01e73617541] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:46.272076 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-476e26d3-0da6-4874-b549-fca70ac6401b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:46.272946 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-476e26d3-0da6-4874-b549-fca70ac6401b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:46.274437 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-476e26d3-0da6-4874-b549-fca70ac6401b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:46.275151 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-476e26d3-0da6-4874-b549-fca70ac6401b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:46.401125 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-760d5234-b4b5-45a0-87f4-d4013b20c7ce tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e87026256304573bfeeda21a156123a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1633f3d4cdb2412b9417cf9eccb946c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:46.408722 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-760d5234-b4b5-45a0-87f4-d4013b20c7ce tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] 10.222.0.35 "GET /compute/v2.1/servers/b8079113-c152-4a13-a741-dbdc2cc01843" status: 200 len: 1315 microversion: 2.1 time: 0.189521 Aug 07 04:57:46.409342 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 373/699] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:46 2021] GET /compute/v2.1/servers/b8079113-c152-4a13-a741-dbdc2cc01843 => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:57:46.417190 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-ec21ac5a-d6b2-4778-810a-e303b5af713b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:46.418134 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-ec21ac5a-d6b2-4778-810a-e303b5af713b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:46.438825 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ec21ac5a-d6b2-4778-810a-e303b5af713b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:46.439571 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ec21ac5a-d6b2-4778-810a-e303b5af713b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:46.441438 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ec21ac5a-d6b2-4778-810a-e303b5af713b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:46.442364 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ec21ac5a-d6b2-4778-810a-e303b5af713b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:46.447043 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-476e26d3-0da6-4874-b549-fca70ac6401b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:46.455056 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-476e26d3-0da6-4874-b549-fca70ac6401b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541" status: 200 len: 1510 microversion: 2.1 time: 0.210768 Aug 07 04:57:46.455627 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 327/700] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:46 2021] GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541 => generated 1510 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:46.573097 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-ec21ac5a-d6b2-4778-810a-e303b5af713b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:46.580880 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-ec21ac5a-d6b2-4778-810a-e303b5af713b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:46.582364 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-ec21ac5a-d6b2-4778-810a-e303b5af713b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:46.583490 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-ec21ac5a-d6b2-4778-810a-e303b5af713b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1720 microversion: 2.20 time: 0.173216 Aug 07 04:57:46.584050 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 374/701] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:57:46 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1720 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:57:47.112049 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-aeb3d7ed-de4e-46f2-b751-225c9d231f0d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:47.112764 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-aeb3d7ed-de4e-46f2-b751-225c9d231f0d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:47.120703 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-aeb3d7ed-de4e-46f2-b751-225c9d231f0d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:47.121239 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-aeb3d7ed-de4e-46f2-b751-225c9d231f0d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:47.121938 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-aeb3d7ed-de4e-46f2-b751-225c9d231f0d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:47.122374 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-aeb3d7ed-de4e-46f2-b751-225c9d231f0d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:47.251559 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-aeb3d7ed-de4e-46f2-b751-225c9d231f0d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:47.260709 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-aeb3d7ed-de4e-46f2-b751-225c9d231f0d tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1522 microversion: 2.1 time: 0.152189 Aug 07 04:57:47.269946 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 328/702] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:47 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:47.425898 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-f80564d6-d7a6-431f-893a-ea3b10af58a9 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:47.426567 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-f80564d6-d7a6-431f-893a-ea3b10af58a9 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] [instance: b8079113-c152-4a13-a741-dbdc2cc01843] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:47.434556 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f80564d6-d7a6-431f-893a-ea3b10af58a9 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:47.435123 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f80564d6-d7a6-431f-893a-ea3b10af58a9 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:47.436319 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f80564d6-d7a6-431f-893a-ea3b10af58a9 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:47.436977 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f80564d6-d7a6-431f-893a-ea3b10af58a9 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:47.474312 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-6f645bd4-6756-47b5-90d8-8b184523ae3a tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:47.475481 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-6f645bd4-6756-47b5-90d8-8b184523ae3a tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 4b54c939-5f03-4579-bb04-d01e73617541] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:47.500104 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6f645bd4-6756-47b5-90d8-8b184523ae3a tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:47.501059 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6f645bd4-6756-47b5-90d8-8b184523ae3a tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:47.502098 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6f645bd4-6756-47b5-90d8-8b184523ae3a tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:47.502735 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6f645bd4-6756-47b5-90d8-8b184523ae3a tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:47.644144 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-6f645bd4-6756-47b5-90d8-8b184523ae3a tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:47.652298 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-6f645bd4-6756-47b5-90d8-8b184523ae3a tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541" status: 200 len: 1510 microversion: 2.1 time: 0.182566 Aug 07 04:57:47.661829 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 329/703] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:47 2021] GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541 => generated 1510 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:47.667579 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-1413d9f6-5974-4750-9e63-ff2903ef00d0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:47.668196 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-1413d9f6-5974-4750-9e63-ff2903ef00d0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:47.674523 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1413d9f6-5974-4750-9e63-ff2903ef00d0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:47.675213 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1413d9f6-5974-4750-9e63-ff2903ef00d0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:47.676195 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1413d9f6-5974-4750-9e63-ff2903ef00d0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:47.676808 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1413d9f6-5974-4750-9e63-ff2903ef00d0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:47.812985 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-1413d9f6-5974-4750-9e63-ff2903ef00d0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:47.822612 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-1413d9f6-5974-4750-9e63-ff2903ef00d0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:47.824137 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-1413d9f6-5974-4750-9e63-ff2903ef00d0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:47.825519 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-1413d9f6-5974-4750-9e63-ff2903ef00d0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1720 microversion: 2.20 time: 0.162494 Aug 07 04:57:47.826274 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 330/704] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:57:47 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:57:47.906549 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-f80564d6-d7a6-431f-893a-ea3b10af58a9 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e87026256304573bfeeda21a156123a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1633f3d4cdb2412b9417cf9eccb946c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:47.914347 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-f80564d6-d7a6-431f-893a-ea3b10af58a9 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] 10.222.0.35 "GET /compute/v2.1/servers/b8079113-c152-4a13-a741-dbdc2cc01843" status: 200 len: 1464 microversion: 2.1 time: 0.492051 Aug 07 04:57:47.915591 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 375/705] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:47 2021] GET /compute/v2.1/servers/b8079113-c152-4a13-a741-dbdc2cc01843 => generated 1464 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:47.963996 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-a086926f-8147-41b5-8cbd-df37462bab8b tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:47.965431 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-a086926f-8147-41b5-8cbd-df37462bab8b tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] [instance: b8079113-c152-4a13-a741-dbdc2cc01843] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:47.971777 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a086926f-8147-41b5-8cbd-df37462bab8b tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:47.972494 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a086926f-8147-41b5-8cbd-df37462bab8b tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:47.973481 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a086926f-8147-41b5-8cbd-df37462bab8b tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:47.974063 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a086926f-8147-41b5-8cbd-df37462bab8b tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:48.005913 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-a086926f-8147-41b5-8cbd-df37462bab8b tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] [instance: b8079113-c152-4a13-a741-dbdc2cc01843] Going to try to terminate instance {{(pid=107485) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 07 04:57:48.106987 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [req-804cf993-7940-4915-ac28-cee5d7158b83 req-44de000e-c9eb-4358-b400-c6277f4a6101 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90d6eef5-1c82-472b-adfb-aeaa1e93d502", "name": "network-vif-deleted", "tag": "bd78445c-a49c-49cb-abaf-0ddaf6492e2c"}]} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:57:48.108905 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 04:57:48.108905 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: warnings.warn(msg) Aug 07 04:57:48.115142 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-a086926f-8147-41b5-8cbd-df37462bab8b tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] 10.222.0.35 "DELETE /compute/v2.1/servers/b8079113-c152-4a13-a741-dbdc2cc01843" status: 204 len: 0 microversion: 2.1 time: 0.155135 Aug 07 04:57:48.116710 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 331/706] 10.222.0.35 () {58 vars in 1239 bytes} [Sat Aug 7 04:57:47 2021] DELETE /compute/v2.1/servers/b8079113-c152-4a13-a741-dbdc2cc01843 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 04:57:48.117689 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-804cf993-7940-4915-ac28-cee5d7158b83 req-44de000e-c9eb-4358-b400-c6277f4a6101 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:48.118211 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-804cf993-7940-4915-ac28-cee5d7158b83 req-44de000e-c9eb-4358-b400-c6277f4a6101 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:48.125458 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-ee33d4a9-78f1-4572-8fea-905353fa1c5f tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:48.126414 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-ee33d4a9-78f1-4572-8fea-905353fa1c5f tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] [instance: b8079113-c152-4a13-a741-dbdc2cc01843] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:48.133410 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.compute.server_external_events [req-804cf993-7940-4915-ac28-cee5d7158b83 req-44de000e-c9eb-4358-b400-c6277f4a6101 service nova] Creating event network-vif-deleted:bd78445c-a49c-49cb-abaf-0ddaf6492e2c for instance 90d6eef5-1c82-472b-adfb-aeaa1e93d502 on hv-cinder-80374 Aug 07 04:57:48.133787 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ee33d4a9-78f1-4572-8fea-905353fa1c5f tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:48.134336 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ee33d4a9-78f1-4572-8fea-905353fa1c5f tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:48.134989 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ee33d4a9-78f1-4572-8fea-905353fa1c5f tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:48.135418 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ee33d4a9-78f1-4572-8fea-905353fa1c5f tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:48.140081 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [req-804cf993-7940-4915-ac28-cee5d7158b83 req-44de000e-c9eb-4358-b400-c6277f4a6101 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045207 Aug 07 04:57:48.140916 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 376/707] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 04:57:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 04:57:48.281196 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-cbeacd14-afbc-4127-9ed1-660e1197b1fb tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:48.290517 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-cbeacd14-afbc-4127-9ed1-660e1197b1fb tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:48.296915 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-cbeacd14-afbc-4127-9ed1-660e1197b1fb tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:48.297364 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-cbeacd14-afbc-4127-9ed1-660e1197b1fb tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:48.298155 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-cbeacd14-afbc-4127-9ed1-660e1197b1fb tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:48.298858 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-cbeacd14-afbc-4127-9ed1-660e1197b1fb tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:48.371504 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-cbeacd14-afbc-4127-9ed1-660e1197b1fb tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aa1bdc4c4f411a81e254f9919962d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54c5afb01f5471297a24ec0ece9d506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:48.379862 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-cbeacd14-afbc-4127-9ed1-660e1197b1fb tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 200 len: 1307 microversion: 2.1 time: 0.105325 Aug 07 04:57:48.398775 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 377/708] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:48 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 1307 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:48.575609 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-ee33d4a9-78f1-4572-8fea-905353fa1c5f tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e87026256304573bfeeda21a156123a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1633f3d4cdb2412b9417cf9eccb946c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:48.584049 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-ee33d4a9-78f1-4572-8fea-905353fa1c5f tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] 10.222.0.35 "GET /compute/v2.1/servers/b8079113-c152-4a13-a741-dbdc2cc01843" status: 200 len: 1470 microversion: 2.1 time: 0.462916 Aug 07 04:57:48.585192 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 332/709] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:48 2021] GET /compute/v2.1/servers/b8079113-c152-4a13-a741-dbdc2cc01843 => generated 1470 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:48.672127 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-149178d7-3583-4f21-99a9-d259c352d5b2 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:48.672858 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-149178d7-3583-4f21-99a9-d259c352d5b2 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 4b54c939-5f03-4579-bb04-d01e73617541] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:48.682841 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-149178d7-3583-4f21-99a9-d259c352d5b2 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:48.683529 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-149178d7-3583-4f21-99a9-d259c352d5b2 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:48.684699 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-149178d7-3583-4f21-99a9-d259c352d5b2 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:48.685497 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-149178d7-3583-4f21-99a9-d259c352d5b2 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:48.844669 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-c3514760-b66b-4998-a7a9-942d2123cb94 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:48.845538 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-c3514760-b66b-4998-a7a9-942d2123cb94 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:48.857041 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c3514760-b66b-4998-a7a9-942d2123cb94 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:48.857041 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c3514760-b66b-4998-a7a9-942d2123cb94 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:48.857825 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c3514760-b66b-4998-a7a9-942d2123cb94 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:48.859055 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c3514760-b66b-4998-a7a9-942d2123cb94 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:48.928734 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-149178d7-3583-4f21-99a9-d259c352d5b2 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:48.942807 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-149178d7-3583-4f21-99a9-d259c352d5b2 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541" status: 200 len: 1510 microversion: 2.1 time: 0.276838 Aug 07 04:57:48.943668 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 378/710] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:48 2021] GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541 => generated 1510 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:49.037491 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-c3514760-b66b-4998-a7a9-942d2123cb94 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:49.047871 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-c3514760-b66b-4998-a7a9-942d2123cb94 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:49.049587 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-c3514760-b66b-4998-a7a9-942d2123cb94 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:49.050743 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-c3514760-b66b-4998-a7a9-942d2123cb94 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1720 microversion: 2.20 time: 0.209965 Aug 07 04:57:49.051952 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 333/711] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:57:48 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1720 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 04:57:49.396638 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-2bac5aa6-d60d-4a01-b643-44dac2d15d71 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:49.397318 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-2bac5aa6-d60d-4a01-b643-44dac2d15d71 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] [instance: 90d6eef5-1c82-472b-adfb-aeaa1e93d502] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:49.403452 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2bac5aa6-d60d-4a01-b643-44dac2d15d71 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:49.403889 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2bac5aa6-d60d-4a01-b643-44dac2d15d71 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:49.404652 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2bac5aa6-d60d-4a01-b643-44dac2d15d71 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:49.405113 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2bac5aa6-d60d-4a01-b643-44dac2d15d71 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:49.418536 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.wsgi [None req-2bac5aa6-d60d-4a01-b643-44dac2d15d71 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] HTTP exception thrown: Instance 90d6eef5-1c82-472b-adfb-aeaa1e93d502 could not be found. Aug 07 04:57:49.419117 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-2bac5aa6-d60d-4a01-b643-44dac2d15d71 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] Returning 404 to user: Instance 90d6eef5-1c82-472b-adfb-aeaa1e93d502 could not be found. {{(pid=107486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 07 04:57:49.419941 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-2bac5aa6-d60d-4a01-b643-44dac2d15d71 tempest-ServerRescueNegativeTestJSON-1946198985 tempest-ServerRescueNegativeTestJSON-1946198985-project] 10.222.0.35 "GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502" status: 404 len: 111 microversion: 2.1 time: 0.027135 Aug 07 04:57:49.420471 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 379/712] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:49 2021] GET /compute/v2.1/servers/90d6eef5-1c82-472b-adfb-aeaa1e93d502 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 04:57:49.602304 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-3d69522b-4177-4e15-b875-5abfb5b75d4b tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:49.602915 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-3d69522b-4177-4e15-b875-5abfb5b75d4b tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] [instance: b8079113-c152-4a13-a741-dbdc2cc01843] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:49.609126 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3d69522b-4177-4e15-b875-5abfb5b75d4b tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:49.609859 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3d69522b-4177-4e15-b875-5abfb5b75d4b tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:49.610815 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3d69522b-4177-4e15-b875-5abfb5b75d4b tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:49.611410 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3d69522b-4177-4e15-b875-5abfb5b75d4b tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:49.741504 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-3d69522b-4177-4e15-b875-5abfb5b75d4b tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e87026256304573bfeeda21a156123a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1633f3d4cdb2412b9417cf9eccb946c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:49.749399 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-3d69522b-4177-4e15-b875-5abfb5b75d4b tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] 10.222.0.35 "GET /compute/v2.1/servers/b8079113-c152-4a13-a741-dbdc2cc01843" status: 200 len: 1470 microversion: 2.1 time: 0.151253 Aug 07 04:57:49.749971 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 334/713] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:49 2021] GET /compute/v2.1/servers/b8079113-c152-4a13-a741-dbdc2cc01843 => generated 1470 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:49.959669 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-0bc41766-a65d-487b-bbc8-f9b5dc2059b9 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:49.960198 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-0bc41766-a65d-487b-bbc8-f9b5dc2059b9 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 4b54c939-5f03-4579-bb04-d01e73617541] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:49.967237 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0bc41766-a65d-487b-bbc8-f9b5dc2059b9 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:49.967703 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0bc41766-a65d-487b-bbc8-f9b5dc2059b9 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:49.968845 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0bc41766-a65d-487b-bbc8-f9b5dc2059b9 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:49.969460 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0bc41766-a65d-487b-bbc8-f9b5dc2059b9 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:50.005306 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0bc41766-a65d-487b-bbc8-f9b5dc2059b9 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:50.005748 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0bc41766-a65d-487b-bbc8-f9b5dc2059b9 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:50.006199 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.objects.instance [None req-0bc41766-a65d-487b-bbc8-f9b5dc2059b9 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lazy-loading 'fault' on Instance uuid 4b54c939-5f03-4579-bb04-d01e73617541 {{(pid=107486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 04:57:50.069538 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-b3d0a607-4901-48bd-8792-21a5ebe3fd78 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:50.070139 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-b3d0a607-4901-48bd-8792-21a5ebe3fd78 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:50.076683 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b3d0a607-4901-48bd-8792-21a5ebe3fd78 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:50.077216 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b3d0a607-4901-48bd-8792-21a5ebe3fd78 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:50.077984 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b3d0a607-4901-48bd-8792-21a5ebe3fd78 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:50.078415 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b3d0a607-4901-48bd-8792-21a5ebe3fd78 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:50.100136 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-0bc41766-a65d-487b-bbc8-f9b5dc2059b9 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:50.107429 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-0bc41766-a65d-487b-bbc8-f9b5dc2059b9 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541" status: 200 len: 1307 microversion: 2.1 time: 0.151895 Aug 07 04:57:50.108328 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 380/714] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:49 2021] GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541 => generated 1307 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:50.156670 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [req-9783d337-d207-46c3-ae77-175de4131076 req-3f278abc-71c9-4bdb-a89d-951dbea9dd1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b54c939-5f03-4579-bb04-d01e73617541", "name": "network-vif-deleted", "tag": "bf23d849-0e24-47ab-ae33-6002837e92e0"}]} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:57:50.158658 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 04:57:50.158658 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: warnings.warn(msg) Aug 07 04:57:50.165693 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-9783d337-d207-46c3-ae77-175de4131076 req-3f278abc-71c9-4bdb-a89d-951dbea9dd1f service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:50.166264 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-9783d337-d207-46c3-ae77-175de4131076 req-3f278abc-71c9-4bdb-a89d-951dbea9dd1f service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:50.177134 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.compute.server_external_events [req-9783d337-d207-46c3-ae77-175de4131076 req-3f278abc-71c9-4bdb-a89d-951dbea9dd1f service nova] Creating event network-vif-deleted:bf23d849-0e24-47ab-ae33-6002837e92e0 for instance 4b54c939-5f03-4579-bb04-d01e73617541 on hv-cinder-80374 Aug 07 04:57:50.182631 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [req-9783d337-d207-46c3-ae77-175de4131076 req-3f278abc-71c9-4bdb-a89d-951dbea9dd1f service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029419 Aug 07 04:57:50.183377 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 381/715] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 04:57:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 04:57:50.205922 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-b3d0a607-4901-48bd-8792-21a5ebe3fd78 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:50.214399 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-b3d0a607-4901-48bd-8792-21a5ebe3fd78 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:50.215812 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-b3d0a607-4901-48bd-8792-21a5ebe3fd78 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:50.217003 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-b3d0a607-4901-48bd-8792-21a5ebe3fd78 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1720 microversion: 2.20 time: 0.151189 Aug 07 04:57:50.217549 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 335/716] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:57:50 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 04:57:50.767200 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-a6460138-c425-4969-9d82-07bf55ec99f9 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:50.768226 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-a6460138-c425-4969-9d82-07bf55ec99f9 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] [instance: b8079113-c152-4a13-a741-dbdc2cc01843] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:50.795888 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a6460138-c425-4969-9d82-07bf55ec99f9 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:50.796330 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a6460138-c425-4969-9d82-07bf55ec99f9 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:50.797145 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a6460138-c425-4969-9d82-07bf55ec99f9 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:50.797581 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a6460138-c425-4969-9d82-07bf55ec99f9 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:51.123346 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-579aa8df-327c-4529-b703-931b52e486c6 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:51.123952 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-579aa8df-327c-4529-b703-931b52e486c6 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 4b54c939-5f03-4579-bb04-d01e73617541] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:51.130199 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-579aa8df-327c-4529-b703-931b52e486c6 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:51.130644 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-579aa8df-327c-4529-b703-931b52e486c6 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:51.131423 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-579aa8df-327c-4529-b703-931b52e486c6 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:51.131854 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-579aa8df-327c-4529-b703-931b52e486c6 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:51.146658 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.wsgi [None req-579aa8df-327c-4529-b703-931b52e486c6 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] HTTP exception thrown: Instance 4b54c939-5f03-4579-bb04-d01e73617541 could not be found. Aug 07 04:57:51.147268 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-579aa8df-327c-4529-b703-931b52e486c6 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Returning 404 to user: Instance 4b54c939-5f03-4579-bb04-d01e73617541 could not be found. {{(pid=107485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 07 04:57:51.148105 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-579aa8df-327c-4529-b703-931b52e486c6 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541" status: 404 len: 111 microversion: 2.1 time: 0.028475 Aug 07 04:57:51.149375 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 336/717] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:51 2021] GET /compute/v2.1/servers/4b54c939-5f03-4579-bb04-d01e73617541 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 04:57:51.236290 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-023b2152-462d-48d1-8213-d6556897b4a4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:51.237489 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-023b2152-462d-48d1-8213-d6556897b4a4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:51.263566 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-023b2152-462d-48d1-8213-d6556897b4a4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:51.263566 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-023b2152-462d-48d1-8213-d6556897b4a4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:51.265031 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-023b2152-462d-48d1-8213-d6556897b4a4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:51.265981 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-023b2152-462d-48d1-8213-d6556897b4a4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:51.346872 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-a6460138-c425-4969-9d82-07bf55ec99f9 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e87026256304573bfeeda21a156123a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1633f3d4cdb2412b9417cf9eccb946c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:51.357450 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-a6460138-c425-4969-9d82-07bf55ec99f9 tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] 10.222.0.35 "GET /compute/v2.1/servers/b8079113-c152-4a13-a741-dbdc2cc01843" status: 200 len: 1470 microversion: 2.1 time: 0.594248 Aug 07 04:57:51.358428 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 382/718] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:50 2021] GET /compute/v2.1/servers/b8079113-c152-4a13-a741-dbdc2cc01843 => generated 1470 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:51.396767 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-023b2152-462d-48d1-8213-d6556897b4a4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:51.405398 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-023b2152-462d-48d1-8213-d6556897b4a4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:51.406962 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-023b2152-462d-48d1-8213-d6556897b4a4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:51.408101 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-023b2152-462d-48d1-8213-d6556897b4a4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1720 microversion: 2.20 time: 0.176088 Aug 07 04:57:51.408648 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 337/719] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:57:51 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1720 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 04:57:52.209350 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [req-edc0ac65-26a0-4b08-8ed7-db6cc45d661c req-4013325f-edf6-4a35-8a89-4b31e3524ebd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8079113-c152-4a13-a741-dbdc2cc01843", "name": "network-vif-deleted", "tag": "c11cc320-a262-4982-92a9-a07cac9ca25f"}]} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:57:52.213194 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 04:57:52.213194 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: warnings.warn(msg) Aug 07 04:57:52.220600 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-edc0ac65-26a0-4b08-8ed7-db6cc45d661c req-4013325f-edf6-4a35-8a89-4b31e3524ebd service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:52.221146 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-edc0ac65-26a0-4b08-8ed7-db6cc45d661c req-4013325f-edf6-4a35-8a89-4b31e3524ebd service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:52.233871 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.compute.server_external_events [req-edc0ac65-26a0-4b08-8ed7-db6cc45d661c req-4013325f-edf6-4a35-8a89-4b31e3524ebd service nova] Creating event network-vif-deleted:c11cc320-a262-4982-92a9-a07cac9ca25f for instance b8079113-c152-4a13-a741-dbdc2cc01843 on hv-cinder-80374 Aug 07 04:57:52.240394 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [req-edc0ac65-26a0-4b08-8ed7-db6cc45d661c req-4013325f-edf6-4a35-8a89-4b31e3524ebd service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034732 Aug 07 04:57:52.241030 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 383/720] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 04:57:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 04:57:52.291662 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-8fb0e6e6-a82b-453c-bca8-e307ebe444e7 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:52.292214 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-8fb0e6e6-a82b-453c-bca8-e307ebe444e7 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:52.298975 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8fb0e6e6-a82b-453c-bca8-e307ebe444e7 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:52.299510 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8fb0e6e6-a82b-453c-bca8-e307ebe444e7 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:52.300481 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8fb0e6e6-a82b-453c-bca8-e307ebe444e7 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:52.301386 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8fb0e6e6-a82b-453c-bca8-e307ebe444e7 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:52.335395 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-8fb0e6e6-a82b-453c-bca8-e307ebe444e7 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5] Going to try to terminate instance {{(pid=107485) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 07 04:57:52.374641 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-a2d080a5-c923-454b-83b6-9572ee24996c tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:52.375299 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-a2d080a5-c923-454b-83b6-9572ee24996c tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] [instance: b8079113-c152-4a13-a741-dbdc2cc01843] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:52.382056 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a2d080a5-c923-454b-83b6-9572ee24996c tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:52.382765 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a2d080a5-c923-454b-83b6-9572ee24996c tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:52.384373 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a2d080a5-c923-454b-83b6-9572ee24996c tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:52.385005 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a2d080a5-c923-454b-83b6-9572ee24996c tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:52.432400 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a2d080a5-c923-454b-83b6-9572ee24996c tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:52.432830 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a2d080a5-c923-454b-83b6-9572ee24996c tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:52.433647 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.objects.instance [None req-a2d080a5-c923-454b-83b6-9572ee24996c tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lazy-loading 'fault' on Instance uuid b8079113-c152-4a13-a741-dbdc2cc01843 {{(pid=107486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 04:57:52.451848 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-8fb0e6e6-a82b-453c-bca8-e307ebe444e7 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "DELETE /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5" status: 204 len: 0 microversion: 2.1 time: 0.165081 Aug 07 04:57:52.455775 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 338/721] 10.222.0.35 () {58 vars in 1239 bytes} [Sat Aug 7 04:57:52 2021] DELETE /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 04:57:52.462014 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-b2899687-98e1-4771-b280-3c81738609c9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:52.463214 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-b2899687-98e1-4771-b280-3c81738609c9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:52.471026 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b2899687-98e1-4771-b280-3c81738609c9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:52.472455 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b2899687-98e1-4771-b280-3c81738609c9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:52.474968 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b2899687-98e1-4771-b280-3c81738609c9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:52.475581 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b2899687-98e1-4771-b280-3c81738609c9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:52.493776 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-a2d080a5-c923-454b-83b6-9572ee24996c tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e87026256304573bfeeda21a156123a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1633f3d4cdb2412b9417cf9eccb946c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:52.504813 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-a2d080a5-c923-454b-83b6-9572ee24996c tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] 10.222.0.35 "GET /compute/v2.1/servers/b8079113-c152-4a13-a741-dbdc2cc01843" status: 200 len: 1305 microversion: 2.1 time: 0.134101 Aug 07 04:57:52.505608 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 384/722] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:52 2021] GET /compute/v2.1/servers/b8079113-c152-4a13-a741-dbdc2cc01843 => generated 1305 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:57:52.517174 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-1aaf5c9d-13fd-4288-a80e-d4781c2ba616 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:52.518063 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-1aaf5c9d-13fd-4288-a80e-d4781c2ba616 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:52.529079 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1aaf5c9d-13fd-4288-a80e-d4781c2ba616 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:52.529665 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1aaf5c9d-13fd-4288-a80e-d4781c2ba616 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:52.530543 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1aaf5c9d-13fd-4288-a80e-d4781c2ba616 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:52.531075 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1aaf5c9d-13fd-4288-a80e-d4781c2ba616 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:52.748834 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-b2899687-98e1-4771-b280-3c81738609c9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:52.756975 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-b2899687-98e1-4771-b280-3c81738609c9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:52.759492 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-b2899687-98e1-4771-b280-3c81738609c9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:52.761111 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-b2899687-98e1-4771-b280-3c81738609c9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1720 microversion: 2.20 time: 0.303955 Aug 07 04:57:52.764868 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 339/723] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:57:52 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1720 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:57:52.779103 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-1aaf5c9d-13fd-4288-a80e-d4781c2ba616 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:52.786283 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-1aaf5c9d-13fd-4288-a80e-d4781c2ba616 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5" status: 200 len: 1511 microversion: 2.1 time: 0.279935 Aug 07 04:57:52.786833 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 385/724] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:52 2021] GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5 => generated 1511 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:53.521847 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-1c2a8d00-ea93-402b-9778-79b8b3c2e4dc tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:53.522444 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-1c2a8d00-ea93-402b-9778-79b8b3c2e4dc tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] [instance: b8079113-c152-4a13-a741-dbdc2cc01843] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:53.529248 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1c2a8d00-ea93-402b-9778-79b8b3c2e4dc tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:53.529687 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1c2a8d00-ea93-402b-9778-79b8b3c2e4dc tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:53.531128 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1c2a8d00-ea93-402b-9778-79b8b3c2e4dc tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:53.531849 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1c2a8d00-ea93-402b-9778-79b8b3c2e4dc tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:53.548423 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.wsgi [None req-1c2a8d00-ea93-402b-9778-79b8b3c2e4dc tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] HTTP exception thrown: Instance b8079113-c152-4a13-a741-dbdc2cc01843 could not be found. Aug 07 04:57:53.549039 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-1c2a8d00-ea93-402b-9778-79b8b3c2e4dc tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] Returning 404 to user: Instance b8079113-c152-4a13-a741-dbdc2cc01843 could not be found. {{(pid=107485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 07 04:57:53.549872 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-1c2a8d00-ea93-402b-9778-79b8b3c2e4dc tempest-VolumesNegativeTest-1200501723 tempest-VolumesNegativeTest-1200501723-project] 10.222.0.35 "GET /compute/v2.1/servers/b8079113-c152-4a13-a741-dbdc2cc01843" status: 404 len: 111 microversion: 2.1 time: 0.031749 Aug 07 04:57:53.550415 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 340/725] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:53 2021] GET /compute/v2.1/servers/b8079113-c152-4a13-a741-dbdc2cc01843 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 04:57:53.784284 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-be7d30ca-9247-40a7-8ca7-1b179671c3ba tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:53.785876 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-be7d30ca-9247-40a7-8ca7-1b179671c3ba tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:53.792930 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-be7d30ca-9247-40a7-8ca7-1b179671c3ba tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:53.794437 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-be7d30ca-9247-40a7-8ca7-1b179671c3ba tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:53.796099 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-be7d30ca-9247-40a7-8ca7-1b179671c3ba tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:53.796928 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-be7d30ca-9247-40a7-8ca7-1b179671c3ba tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:53.802932 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-f8286362-d511-48fc-9cf5-f4207f1629b7 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:53.803820 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-f8286362-d511-48fc-9cf5-f4207f1629b7 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:53.810744 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f8286362-d511-48fc-9cf5-f4207f1629b7 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:53.811499 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f8286362-d511-48fc-9cf5-f4207f1629b7 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:53.812510 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f8286362-d511-48fc-9cf5-f4207f1629b7 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:53.813211 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f8286362-d511-48fc-9cf5-f4207f1629b7 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:53.948371 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-be7d30ca-9247-40a7-8ca7-1b179671c3ba tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:53.981034 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-be7d30ca-9247-40a7-8ca7-1b179671c3ba tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:53.982739 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-be7d30ca-9247-40a7-8ca7-1b179671c3ba tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:53.984383 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-be7d30ca-9247-40a7-8ca7-1b179671c3ba tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1720 microversion: 2.20 time: 0.203921 Aug 07 04:57:53.985612 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 386/726] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:57:53 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1720 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:57:53.994319 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-f8286362-d511-48fc-9cf5-f4207f1629b7 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:54.002696 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-f8286362-d511-48fc-9cf5-f4207f1629b7 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5" status: 200 len: 1511 microversion: 2.1 time: 0.203332 Aug 07 04:57:54.003668 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 341/727] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:53 2021] GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5 => generated 1511 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:55.003838 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-728b2cd1-de5b-4265-a4c5-0e482871700c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:55.004551 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-728b2cd1-de5b-4265-a4c5-0e482871700c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:55.015917 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-728b2cd1-de5b-4265-a4c5-0e482871700c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:55.016457 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-728b2cd1-de5b-4265-a4c5-0e482871700c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:55.017373 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-728b2cd1-de5b-4265-a4c5-0e482871700c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:55.017822 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-728b2cd1-de5b-4265-a4c5-0e482871700c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:55.022251 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-cde5070c-dcc9-4a86-aeaa-a15f75813d01 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:55.023599 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-cde5070c-dcc9-4a86-aeaa-a15f75813d01 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:55.030091 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-cde5070c-dcc9-4a86-aeaa-a15f75813d01 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:55.030847 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-cde5070c-dcc9-4a86-aeaa-a15f75813d01 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:55.032011 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-cde5070c-dcc9-4a86-aeaa-a15f75813d01 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:55.032662 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-cde5070c-dcc9-4a86-aeaa-a15f75813d01 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:55.282918 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-cde5070c-dcc9-4a86-aeaa-a15f75813d01 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:55.297382 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-cde5070c-dcc9-4a86-aeaa-a15f75813d01 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5" status: 200 len: 1511 microversion: 2.1 time: 0.278078 Aug 07 04:57:55.307725 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 342/728] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:55 2021] GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5 => generated 1511 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:55.362658 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-728b2cd1-de5b-4265-a4c5-0e482871700c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:55.372863 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-728b2cd1-de5b-4265-a4c5-0e482871700c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:55.374736 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-728b2cd1-de5b-4265-a4c5-0e482871700c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:55.376151 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-728b2cd1-de5b-4265-a4c5-0e482871700c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1720 microversion: 2.20 time: 0.376650 Aug 07 04:57:55.376955 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 387/729] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:57:54 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1720 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:57:55.767680 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [req-afc1c247-4eed-4073-8597-a64d93874154 req-5c0f19ab-0015-444f-a129-6e6e27c52343 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5", "name": "network-vif-deleted", "tag": "1e777704-a54d-44cc-8174-3b1b99eb2c91"}]} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:57:55.770386 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 04:57:55.770386 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: warnings.warn(msg) Aug 07 04:57:55.791024 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-afc1c247-4eed-4073-8597-a64d93874154 req-5c0f19ab-0015-444f-a129-6e6e27c52343 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:55.804618 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-afc1c247-4eed-4073-8597-a64d93874154 req-5c0f19ab-0015-444f-a129-6e6e27c52343 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:55.821730 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.compute.server_external_events [req-afc1c247-4eed-4073-8597-a64d93874154 req-5c0f19ab-0015-444f-a129-6e6e27c52343 service nova] Creating event network-vif-deleted:1e777704-a54d-44cc-8174-3b1b99eb2c91 for instance 5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5 on hv-cinder-80374 Aug 07 04:57:55.828698 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [req-afc1c247-4eed-4073-8597-a64d93874154 req-5c0f19ab-0015-444f-a129-6e6e27c52343 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066044 Aug 07 04:57:55.829768 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 343/730] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 04:57:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:57:56.315459 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-25921610-7438-43d5-a4d6-d73870c5ac6b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:56.319397 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-25921610-7438-43d5-a4d6-d73870c5ac6b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:56.328230 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-25921610-7438-43d5-a4d6-d73870c5ac6b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:56.328755 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-25921610-7438-43d5-a4d6-d73870c5ac6b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:56.329650 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-25921610-7438-43d5-a4d6-d73870c5ac6b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:56.330186 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-25921610-7438-43d5-a4d6-d73870c5ac6b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:56.379279 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-25921610-7438-43d5-a4d6-d73870c5ac6b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:56.381036 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-25921610-7438-43d5-a4d6-d73870c5ac6b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:56.381036 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.objects.instance [None req-25921610-7438-43d5-a4d6-d73870c5ac6b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lazy-loading 'fault' on Instance uuid 5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5 {{(pid=107486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 04:57:56.414476 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-c75f8217-0208-4501-b21f-e8acf01a9528 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:56.416304 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-c75f8217-0208-4501-b21f-e8acf01a9528 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:56.425521 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c75f8217-0208-4501-b21f-e8acf01a9528 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:56.426210 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c75f8217-0208-4501-b21f-e8acf01a9528 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:56.427192 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c75f8217-0208-4501-b21f-e8acf01a9528 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:56.428753 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c75f8217-0208-4501-b21f-e8acf01a9528 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:56.438170 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-25921610-7438-43d5-a4d6-d73870c5ac6b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:56.447353 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-25921610-7438-43d5-a4d6-d73870c5ac6b tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5" status: 200 len: 1308 microversion: 2.1 time: 0.135363 Aug 07 04:57:56.448387 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 388/731] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:56 2021] GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5 => generated 1308 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:56.678988 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-c75f8217-0208-4501-b21f-e8acf01a9528 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:56.689088 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-c75f8217-0208-4501-b21f-e8acf01a9528 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:56.690833 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-c75f8217-0208-4501-b21f-e8acf01a9528 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:56.692034 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-c75f8217-0208-4501-b21f-e8acf01a9528 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1720 microversion: 2.20 time: 0.300801 Aug 07 04:57:56.692845 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 344/732] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:57:56 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1720 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:57:57.468421 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-a8c0b761-28cf-4a2e-9ade-643336ff0a60 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:57.469205 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-a8c0b761-28cf-4a2e-9ade-643336ff0a60 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:57.475059 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a8c0b761-28cf-4a2e-9ade-643336ff0a60 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:57.475504 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a8c0b761-28cf-4a2e-9ade-643336ff0a60 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:57.476275 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a8c0b761-28cf-4a2e-9ade-643336ff0a60 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:57.476911 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a8c0b761-28cf-4a2e-9ade-643336ff0a60 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:57.490612 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.wsgi [None req-a8c0b761-28cf-4a2e-9ade-643336ff0a60 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] HTTP exception thrown: Instance 5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5 could not be found. Aug 07 04:57:57.491219 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-a8c0b761-28cf-4a2e-9ade-643336ff0a60 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Returning 404 to user: Instance 5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5 could not be found. {{(pid=107486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 07 04:57:57.492718 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-a8c0b761-28cf-4a2e-9ade-643336ff0a60 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5" status: 404 len: 111 microversion: 2.1 time: 0.027434 Aug 07 04:57:57.493497 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 389/733] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:57 2021] GET /compute/v2.1/servers/5d58b6bf-11ba-49e4-bc5d-3ac6abc919a5 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 04:57:57.501457 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-f63046fe-4e7d-4fb8-a73b-41283297774c tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:57.502583 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-f63046fe-4e7d-4fb8-a73b-41283297774c tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: c8b3c5de-8c8d-47a6-bee5-9422c9a66583] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:57.510196 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f63046fe-4e7d-4fb8-a73b-41283297774c tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:57.511054 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f63046fe-4e7d-4fb8-a73b-41283297774c tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:57.512166 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f63046fe-4e7d-4fb8-a73b-41283297774c tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:57.512946 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f63046fe-4e7d-4fb8-a73b-41283297774c tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:57.540456 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-f63046fe-4e7d-4fb8-a73b-41283297774c tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: c8b3c5de-8c8d-47a6-bee5-9422c9a66583] Going to try to terminate instance {{(pid=107485) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 07 04:57:57.615429 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-f63046fe-4e7d-4fb8-a73b-41283297774c tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "DELETE /compute/v2.1/servers/c8b3c5de-8c8d-47a6-bee5-9422c9a66583" status: 204 len: 0 microversion: 2.1 time: 0.117283 Aug 07 04:57:57.618215 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 345/734] 10.222.0.35 () {58 vars in 1239 bytes} [Sat Aug 7 04:57:57 2021] DELETE /compute/v2.1/servers/c8b3c5de-8c8d-47a6-bee5-9422c9a66583 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 04:57:57.626656 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-04066c3d-7926-4419-85ae-e4f5a04f01dd tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:57.627375 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-04066c3d-7926-4419-85ae-e4f5a04f01dd tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: c8b3c5de-8c8d-47a6-bee5-9422c9a66583] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:57.633704 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-04066c3d-7926-4419-85ae-e4f5a04f01dd tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:57.634243 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-04066c3d-7926-4419-85ae-e4f5a04f01dd tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:57.635222 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-04066c3d-7926-4419-85ae-e4f5a04f01dd tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:57.635731 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-04066c3d-7926-4419-85ae-e4f5a04f01dd tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:57.712451 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-62c2e3c2-45be-4ef0-980e-bf4eb68af9d4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:57.714248 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-62c2e3c2-45be-4ef0-980e-bf4eb68af9d4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:57.721154 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-62c2e3c2-45be-4ef0-980e-bf4eb68af9d4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:57.722420 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-62c2e3c2-45be-4ef0-980e-bf4eb68af9d4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:57.723451 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-62c2e3c2-45be-4ef0-980e-bf4eb68af9d4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:57.724661 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-62c2e3c2-45be-4ef0-980e-bf4eb68af9d4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:57.872743 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-04066c3d-7926-4419-85ae-e4f5a04f01dd tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:57.872966 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-62c2e3c2-45be-4ef0-980e-bf4eb68af9d4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:57.881289 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-62c2e3c2-45be-4ef0-980e-bf4eb68af9d4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:57.882820 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-62c2e3c2-45be-4ef0-980e-bf4eb68af9d4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:57.883974 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-62c2e3c2-45be-4ef0-980e-bf4eb68af9d4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1720 microversion: 2.20 time: 0.176458 Aug 07 04:57:57.884572 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 346/735] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:57:57 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1720 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:57:57.885599 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-04066c3d-7926-4419-85ae-e4f5a04f01dd tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/c8b3c5de-8c8d-47a6-bee5-9422c9a66583" status: 200 len: 1512 microversion: 2.1 time: 0.264551 Aug 07 04:57:57.894657 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 390/736] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:57 2021] GET /compute/v2.1/servers/c8b3c5de-8c8d-47a6-bee5-9422c9a66583 => generated 1512 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:58.906118 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-7bc5a7e2-2bba-443c-9f47-beb276578bbd tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:58.910169 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-46a50c7e-c122-4db1-85c9-8a5467a70493 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:57:58.910820 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-7bc5a7e2-2bba-443c-9f47-beb276578bbd tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:58.913510 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-46a50c7e-c122-4db1-85c9-8a5467a70493 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: c8b3c5de-8c8d-47a6-bee5-9422c9a66583] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:57:58.920528 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7bc5a7e2-2bba-443c-9f47-beb276578bbd tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:58.920736 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-46a50c7e-c122-4db1-85c9-8a5467a70493 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:58.921141 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7bc5a7e2-2bba-443c-9f47-beb276578bbd tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:58.921259 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-46a50c7e-c122-4db1-85c9-8a5467a70493 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:58.921954 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-46a50c7e-c122-4db1-85c9-8a5467a70493 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:58.922114 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7bc5a7e2-2bba-443c-9f47-beb276578bbd tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:57:58.922380 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-46a50c7e-c122-4db1-85c9-8a5467a70493 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:58.922684 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7bc5a7e2-2bba-443c-9f47-beb276578bbd tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:57:59.083669 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-46a50c7e-c122-4db1-85c9-8a5467a70493 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:59.093600 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-46a50c7e-c122-4db1-85c9-8a5467a70493 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/c8b3c5de-8c8d-47a6-bee5-9422c9a66583" status: 200 len: 1512 microversion: 2.1 time: 0.191716 Aug 07 04:57:59.094187 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 391/737] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:57:58 2021] GET /compute/v2.1/servers/c8b3c5de-8c8d-47a6-bee5-9422c9a66583 => generated 1512 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:57:59.120611 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-7bc5a7e2-2bba-443c-9f47-beb276578bbd tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:59.128924 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-7bc5a7e2-2bba-443c-9f47-beb276578bbd tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:59.130809 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-7bc5a7e2-2bba-443c-9f47-beb276578bbd tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:57:59.132022 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-7bc5a7e2-2bba-443c-9f47-beb276578bbd tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1720 microversion: 2.20 time: 0.233318 Aug 07 04:57:59.142812 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 347/738] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:57:58 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1720 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:58:00.111509 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-8cd4f9a0-9d87-4ed3-85a5-80b5f0b4d64a tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:00.112190 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-8cd4f9a0-9d87-4ed3-85a5-80b5f0b4d64a tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: c8b3c5de-8c8d-47a6-bee5-9422c9a66583] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:00.122591 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8cd4f9a0-9d87-4ed3-85a5-80b5f0b4d64a tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:00.123234 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8cd4f9a0-9d87-4ed3-85a5-80b5f0b4d64a tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:00.124629 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8cd4f9a0-9d87-4ed3-85a5-80b5f0b4d64a tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:00.126208 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8cd4f9a0-9d87-4ed3-85a5-80b5f0b4d64a tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:00.150339 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-6bafc3e6-59c0-4e30-ad04-2b1183aea62e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:00.150945 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-6bafc3e6-59c0-4e30-ad04-2b1183aea62e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:00.167303 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6bafc3e6-59c0-4e30-ad04-2b1183aea62e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:00.169043 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6bafc3e6-59c0-4e30-ad04-2b1183aea62e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:00.169905 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6bafc3e6-59c0-4e30-ad04-2b1183aea62e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:00.181161 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6bafc3e6-59c0-4e30-ad04-2b1183aea62e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:00.317464 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-8cd4f9a0-9d87-4ed3-85a5-80b5f0b4d64a tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:00.326322 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-8cd4f9a0-9d87-4ed3-85a5-80b5f0b4d64a tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/c8b3c5de-8c8d-47a6-bee5-9422c9a66583" status: 200 len: 1512 microversion: 2.1 time: 0.218495 Aug 07 04:58:00.326754 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 392/739] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:58:00 2021] GET /compute/v2.1/servers/c8b3c5de-8c8d-47a6-bee5-9422c9a66583 => generated 1512 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:58:00.412298 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-6bafc3e6-59c0-4e30-ad04-2b1183aea62e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:00.422150 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-6bafc3e6-59c0-4e30-ad04-2b1183aea62e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:00.423646 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-6bafc3e6-59c0-4e30-ad04-2b1183aea62e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:00.424813 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-6bafc3e6-59c0-4e30-ad04-2b1183aea62e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1741 microversion: 2.20 time: 0.278387 Aug 07 04:58:00.425668 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 348/740] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:58:00 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1741 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 04:58:01.015847 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [req-b392643f-a6f4-4b4d-a81e-411c22ec43b8 req-865875c0-91c8-4e32-8bd4-55cc12e08b49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8b3c5de-8c8d-47a6-bee5-9422c9a66583", "name": "network-vif-deleted", "tag": "2d316e0b-8eea-4346-9431-4ce3f3d44c94"}]} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:58:01.018522 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 04:58:01.018522 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: warnings.warn(msg) Aug 07 04:58:01.026717 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-b392643f-a6f4-4b4d-a81e-411c22ec43b8 req-865875c0-91c8-4e32-8bd4-55cc12e08b49 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:01.027161 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-b392643f-a6f4-4b4d-a81e-411c22ec43b8 req-865875c0-91c8-4e32-8bd4-55cc12e08b49 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:01.039761 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.compute.server_external_events [req-b392643f-a6f4-4b4d-a81e-411c22ec43b8 req-865875c0-91c8-4e32-8bd4-55cc12e08b49 service nova] Creating event network-vif-deleted:2d316e0b-8eea-4346-9431-4ce3f3d44c94 for instance c8b3c5de-8c8d-47a6-bee5-9422c9a66583 on hv-cinder-80374 Aug 07 04:58:01.044964 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [req-b392643f-a6f4-4b4d-a81e-411c22ec43b8 req-865875c0-91c8-4e32-8bd4-55cc12e08b49 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034102 Aug 07 04:58:01.045795 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 393/741] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 04:58:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:58:01.344680 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-9f4b87d2-dd22-465d-9653-f72feb838261 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:01.345511 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-9f4b87d2-dd22-465d-9653-f72feb838261 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: c8b3c5de-8c8d-47a6-bee5-9422c9a66583] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:01.352769 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9f4b87d2-dd22-465d-9653-f72feb838261 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:01.353328 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9f4b87d2-dd22-465d-9653-f72feb838261 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:01.354146 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9f4b87d2-dd22-465d-9653-f72feb838261 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:01.354662 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9f4b87d2-dd22-465d-9653-f72feb838261 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:01.384420 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9f4b87d2-dd22-465d-9653-f72feb838261 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:01.384881 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9f4b87d2-dd22-465d-9653-f72feb838261 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:01.385323 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.objects.instance [None req-9f4b87d2-dd22-465d-9653-f72feb838261 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lazy-loading 'fault' on Instance uuid c8b3c5de-8c8d-47a6-bee5-9422c9a66583 {{(pid=107485) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 04:58:01.424741 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-9f4b87d2-dd22-465d-9653-f72feb838261 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:01.433976 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-9f4b87d2-dd22-465d-9653-f72feb838261 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/c8b3c5de-8c8d-47a6-bee5-9422c9a66583" status: 200 len: 1308 microversion: 2.1 time: 0.093472 Aug 07 04:58:01.434536 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 349/742] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:58:01 2021] GET /compute/v2.1/servers/c8b3c5de-8c8d-47a6-bee5-9422c9a66583 => generated 1308 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:58:01.443719 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-2dfa9d5c-f1ad-4110-8bad-964750ecfb27 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:01.444425 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-2dfa9d5c-f1ad-4110-8bad-964750ecfb27 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:01.451445 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2dfa9d5c-f1ad-4110-8bad-964750ecfb27 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:01.451892 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2dfa9d5c-f1ad-4110-8bad-964750ecfb27 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:01.452667 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2dfa9d5c-f1ad-4110-8bad-964750ecfb27 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:01.453374 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2dfa9d5c-f1ad-4110-8bad-964750ecfb27 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:01.608368 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-2dfa9d5c-f1ad-4110-8bad-964750ecfb27 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:01.626690 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-2dfa9d5c-f1ad-4110-8bad-964750ecfb27 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:01.630299 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-2dfa9d5c-f1ad-4110-8bad-964750ecfb27 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:01.632057 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-2dfa9d5c-f1ad-4110-8bad-964750ecfb27 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1741 microversion: 2.20 time: 0.192196 Aug 07 04:58:01.634270 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 394/743] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:58:01 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1741 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:58:01.818716 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-9eb17d96-4e5b-4acd-8934-e74d295c3c4b tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-452666311", "imageRef": "ddcf95b5-3ea4-4a61-8f54-4b2feadb8682", "flavorRef": "452", "networks": [{"uuid": "25fcf950-049f-4351-99b7-944505ca0693"}]}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:58:01.871121 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.network.neutron [None req-9eb17d96-4e5b-4acd-8934-e74d295c3c4b tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] validate_networks() for [('25fcf950-049f-4351-99b7-944505ca0693', None, None, None)] {{(pid=107485) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 07 04:58:02.247182 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.virt.hardware [None req-9eb17d96-4e5b-4acd-8934-e74d295c3c4b tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Flavor limits 0:0:0 {{(pid=107485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 04:58:02.247601 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.virt.hardware [None req-9eb17d96-4e5b-4acd-8934-e74d295c3c4b tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Image limits 0:0:0 {{(pid=107485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 04:58:02.248077 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.virt.hardware [None req-9eb17d96-4e5b-4acd-8934-e74d295c3c4b tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Flavor pref 0:0:0 {{(pid=107485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 04:58:02.248505 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.virt.hardware [None req-9eb17d96-4e5b-4acd-8934-e74d295c3c4b tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Image pref 0:0:0 {{(pid=107485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 04:58:02.248935 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.virt.hardware [None req-9eb17d96-4e5b-4acd-8934-e74d295c3c4b tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 04:58:02.264377 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9eb17d96-4e5b-4acd-8934-e74d295c3c4b tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:02.264845 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9eb17d96-4e5b-4acd-8934-e74d295c3c4b tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:02.265640 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9eb17d96-4e5b-4acd-8934-e74d295c3c4b tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:02.266064 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9eb17d96-4e5b-4acd-8934-e74d295c3c4b tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:02.283425 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.quota [None req-9eb17d96-4e5b-4acd-8934-e74d295c3c4b tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Getting quotas for project 2df5e22820a1410d94c298e75220eb68. Resources: {'ram', 'cores', 'instances'} {{(pid=107485) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 07 04:58:02.287487 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.quota [None req-9eb17d96-4e5b-4acd-8934-e74d295c3c4b tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Getting quotas for user 3dd371b9690a4fe192c4cdf0b4d9900b and project 2df5e22820a1410d94c298e75220eb68. Resources: {'ram', 'cores', 'instances'} {{(pid=107485) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 07 04:58:02.311082 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-9eb17d96-4e5b-4acd-8934-e74d295c3c4b tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Going to run 1 instances... {{(pid=107485) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 07 04:58:02.313729 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-9eb17d96-4e5b-4acd-8934-e74d295c3c4b tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] [instance: 28314017-c8b0-4a57-8ffb-7fa1aee0232e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ddcf95b5-3ea4-4a61-8f54-4b2feadb8682',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107485) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 07 04:58:02.358179 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-9eb17d96-4e5b-4acd-8934-e74d295c3c4b tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.543114 Aug 07 04:58:02.359191 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 350/744] 10.222.0.35 () {60 vars in 1147 bytes} [Sat Aug 7 04:58:01 2021] POST /compute/v2.1/servers => generated 380 bytes in 545 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 04:58:02.369031 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-e0fcbec5-27bd-4bac-8c71-b66ae2cfb3f1 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:02.369710 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-e0fcbec5-27bd-4bac-8c71-b66ae2cfb3f1 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] [instance: 28314017-c8b0-4a57-8ffb-7fa1aee0232e] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:02.435785 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-e0fcbec5-27bd-4bac-8c71-b66ae2cfb3f1 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd371b9690a4fe192c4cdf0b4d9900b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5e22820a1410d94c298e75220eb68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:02.443877 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-e0fcbec5-27bd-4bac-8c71-b66ae2cfb3f1 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] 10.222.0.35 "GET /compute/v2.1/servers/28314017-c8b0-4a57-8ffb-7fa1aee0232e" status: 200 len: 1218 microversion: 2.1 time: 0.078986 Aug 07 04:58:02.444430 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 395/745] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:58:02 2021] GET /compute/v2.1/servers/28314017-c8b0-4a57-8ffb-7fa1aee0232e => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:58:02.453236 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-af9af382-f42b-40d0-b396-6662d89771c9 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:02.453790 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-af9af382-f42b-40d0-b396-6662d89771c9 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: c8b3c5de-8c8d-47a6-bee5-9422c9a66583] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:02.460026 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-af9af382-f42b-40d0-b396-6662d89771c9 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:02.461186 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-af9af382-f42b-40d0-b396-6662d89771c9 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:02.462113 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-af9af382-f42b-40d0-b396-6662d89771c9 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:02.462984 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-af9af382-f42b-40d0-b396-6662d89771c9 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:02.479177 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.wsgi [None req-af9af382-f42b-40d0-b396-6662d89771c9 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] HTTP exception thrown: Instance c8b3c5de-8c8d-47a6-bee5-9422c9a66583 could not be found. Aug 07 04:58:02.479782 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-af9af382-f42b-40d0-b396-6662d89771c9 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Returning 404 to user: Instance c8b3c5de-8c8d-47a6-bee5-9422c9a66583 could not be found. {{(pid=107485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 07 04:58:02.480620 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-af9af382-f42b-40d0-b396-6662d89771c9 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/c8b3c5de-8c8d-47a6-bee5-9422c9a66583" status: 404 len: 111 microversion: 2.1 time: 0.031603 Aug 07 04:58:02.481409 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 351/746] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:58:02 2021] GET /compute/v2.1/servers/c8b3c5de-8c8d-47a6-bee5-9422c9a66583 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 04:58:02.652540 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-7c45bc21-a40d-4f67-ba1e-19422138ed03 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:02.653261 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-7c45bc21-a40d-4f67-ba1e-19422138ed03 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:02.660989 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-7c45bc21-a40d-4f67-ba1e-19422138ed03 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:02.661699 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-7c45bc21-a40d-4f67-ba1e-19422138ed03 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:02.662569 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-7c45bc21-a40d-4f67-ba1e-19422138ed03 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:02.663100 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-7c45bc21-a40d-4f67-ba1e-19422138ed03 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:02.808290 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-7c45bc21-a40d-4f67-ba1e-19422138ed03 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:02.816948 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-7c45bc21-a40d-4f67-ba1e-19422138ed03 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:02.818832 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-7c45bc21-a40d-4f67-ba1e-19422138ed03 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:02.820727 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-7c45bc21-a40d-4f67-ba1e-19422138ed03 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1741 microversion: 2.20 time: 0.172440 Aug 07 04:58:02.821469 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 396/747] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:58:02 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1741 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:58:03.461939 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-ef8d6f73-f1a5-4d1c-a5aa-a354e85862b8 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:03.462439 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-ef8d6f73-f1a5-4d1c-a5aa-a354e85862b8 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] [instance: 28314017-c8b0-4a57-8ffb-7fa1aee0232e] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:03.469697 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ef8d6f73-f1a5-4d1c-a5aa-a354e85862b8 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:03.470201 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ef8d6f73-f1a5-4d1c-a5aa-a354e85862b8 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:03.470964 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ef8d6f73-f1a5-4d1c-a5aa-a354e85862b8 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:03.471400 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ef8d6f73-f1a5-4d1c-a5aa-a354e85862b8 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:03.578133 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-ef8d6f73-f1a5-4d1c-a5aa-a354e85862b8 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd371b9690a4fe192c4cdf0b4d9900b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5e22820a1410d94c298e75220eb68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:03.586825 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-ef8d6f73-f1a5-4d1c-a5aa-a354e85862b8 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] 10.222.0.35 "GET /compute/v2.1/servers/28314017-c8b0-4a57-8ffb-7fa1aee0232e" status: 200 len: 1278 microversion: 2.1 time: 0.129070 Aug 07 04:58:03.587941 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 352/748] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:58:03 2021] GET /compute/v2.1/servers/28314017-c8b0-4a57-8ffb-7fa1aee0232e => generated 1278 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:58:03.633626 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-0fdc9d2d-eb95-4ec1-91ec-3262995d6f93 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:03.634738 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-0fdc9d2d-eb95-4ec1-91ec-3262995d6f93 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:03.642556 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0fdc9d2d-eb95-4ec1-91ec-3262995d6f93 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:03.643885 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0fdc9d2d-eb95-4ec1-91ec-3262995d6f93 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:03.645049 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0fdc9d2d-eb95-4ec1-91ec-3262995d6f93 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:03.645876 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0fdc9d2d-eb95-4ec1-91ec-3262995d6f93 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:03.675024 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-0fdc9d2d-eb95-4ec1-91ec-3262995d6f93 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Going to try to terminate instance {{(pid=107486) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 07 04:58:03.721640 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [req-fac591bf-b0ee-4e1e-8f25-85bba6034227 req-b75ee277-cb0e-4ff9-8ef9-9c13d5fc235d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "431857b6-a453-44f0-829c-00ed610d5fc2", "name": "network-vif-plugged", "status": "completed", "tag": "6a0264c8-c45c-4fec-b570-31fbf0131107"}]} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:58:03.723656 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 04:58:03.723656 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: warnings.warn(msg) Aug 07 04:58:03.744468 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-fac591bf-b0ee-4e1e-8f25-85bba6034227 req-b75ee277-cb0e-4ff9-8ef9-9c13d5fc235d service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:03.745290 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-fac591bf-b0ee-4e1e-8f25-85bba6034227 req-b75ee277-cb0e-4ff9-8ef9-9c13d5fc235d service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:03.759851 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.compute.server_external_events [req-fac591bf-b0ee-4e1e-8f25-85bba6034227 req-b75ee277-cb0e-4ff9-8ef9-9c13d5fc235d service nova] Creating event network-vif-plugged:6a0264c8-c45c-4fec-b570-31fbf0131107 for instance 431857b6-a453-44f0-829c-00ed610d5fc2 on hv-cinder-80374 Aug 07 04:58:03.765624 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [req-fac591bf-b0ee-4e1e-8f25-85bba6034227 req-b75ee277-cb0e-4ff9-8ef9-9c13d5fc235d service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049447 Aug 07 04:58:03.766241 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 353/749] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 04:58:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 04:58:03.790793 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-0fdc9d2d-eb95-4ec1-91ec-3262995d6f93 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "DELETE /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b" status: 204 len: 0 microversion: 2.1 time: 0.160990 Aug 07 04:58:03.792546 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 397/750] 10.222.0.35 () {58 vars in 1239 bytes} [Sat Aug 7 04:58:03 2021] DELETE /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 04:58:03.801352 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-38876a3c-3505-4ccb-bddf-731171088a08 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:03.802825 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-38876a3c-3505-4ccb-bddf-731171088a08 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:03.813156 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-38876a3c-3505-4ccb-bddf-731171088a08 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:03.813844 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-38876a3c-3505-4ccb-bddf-731171088a08 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:03.814966 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-38876a3c-3505-4ccb-bddf-731171088a08 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:03.815654 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-38876a3c-3505-4ccb-bddf-731171088a08 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:03.848038 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-9ce11d54-9886-46f6-988b-2ebba59a8f98 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:03.849399 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-9ce11d54-9886-46f6-988b-2ebba59a8f98 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:03.856424 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9ce11d54-9886-46f6-988b-2ebba59a8f98 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:03.857198 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9ce11d54-9886-46f6-988b-2ebba59a8f98 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:03.858167 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9ce11d54-9886-46f6-988b-2ebba59a8f98 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:03.858799 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9ce11d54-9886-46f6-988b-2ebba59a8f98 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:04.031410 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-9ce11d54-9886-46f6-988b-2ebba59a8f98 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:04.040306 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-9ce11d54-9886-46f6-988b-2ebba59a8f98 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:04.042050 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-9ce11d54-9886-46f6-988b-2ebba59a8f98 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:04.043439 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-9ce11d54-9886-46f6-988b-2ebba59a8f98 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1741 microversion: 2.20 time: 0.206844 Aug 07 04:58:04.044263 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 398/751] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:58:03 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1741 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:58:04.067413 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-38876a3c-3505-4ccb-bddf-731171088a08 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:04.076180 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-38876a3c-3505-4ccb-bddf-731171088a08 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b" status: 200 len: 1512 microversion: 2.1 time: 0.279482 Aug 07 04:58:04.076747 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 354/752] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:58:03 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b => generated 1512 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:58:04.603678 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-186cc44b-b3f9-4307-9afd-7daf49ca655f tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:04.604296 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-186cc44b-b3f9-4307-9afd-7daf49ca655f tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] [instance: 28314017-c8b0-4a57-8ffb-7fa1aee0232e] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:04.610297 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-186cc44b-b3f9-4307-9afd-7daf49ca655f tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:04.611008 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-186cc44b-b3f9-4307-9afd-7daf49ca655f tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:04.612024 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-186cc44b-b3f9-4307-9afd-7daf49ca655f tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:04.612542 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-186cc44b-b3f9-4307-9afd-7daf49ca655f tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:04.782309 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-186cc44b-b3f9-4307-9afd-7daf49ca655f tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd371b9690a4fe192c4cdf0b4d9900b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5e22820a1410d94c298e75220eb68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:04.791763 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-186cc44b-b3f9-4307-9afd-7daf49ca655f tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] 10.222.0.35 "GET /compute/v2.1/servers/28314017-c8b0-4a57-8ffb-7fa1aee0232e" status: 200 len: 1318 microversion: 2.1 time: 0.191946 Aug 07 04:58:04.792505 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 399/753] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:58:04 2021] GET /compute/v2.1/servers/28314017-c8b0-4a57-8ffb-7fa1aee0232e => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:58:05.061446 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-d8608187-cc3d-427d-aca2-0e33f825fea6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:05.062394 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-d8608187-cc3d-427d-aca2-0e33f825fea6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:05.068932 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d8608187-cc3d-427d-aca2-0e33f825fea6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:05.069487 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d8608187-cc3d-427d-aca2-0e33f825fea6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:05.070755 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d8608187-cc3d-427d-aca2-0e33f825fea6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:05.071267 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d8608187-cc3d-427d-aca2-0e33f825fea6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:05.092492 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-3e17946f-804e-4608-8ef3-b7f13bd4692d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:05.093381 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-3e17946f-804e-4608-8ef3-b7f13bd4692d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:05.103531 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3e17946f-804e-4608-8ef3-b7f13bd4692d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:05.106731 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3e17946f-804e-4608-8ef3-b7f13bd4692d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:05.107635 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3e17946f-804e-4608-8ef3-b7f13bd4692d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:05.108097 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3e17946f-804e-4608-8ef3-b7f13bd4692d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:05.254983 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-3e17946f-804e-4608-8ef3-b7f13bd4692d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:05.262502 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-3e17946f-804e-4608-8ef3-b7f13bd4692d tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b" status: 200 len: 1512 microversion: 2.1 time: 0.173598 Aug 07 04:58:05.263076 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 400/754] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:58:05 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b => generated 1512 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:58:05.276683 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [req-ec7d6fb6-6c40-4a62-8393-ad732761c712 req-fa06b003-9a89-4123-a07f-d6fa49024829 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28314017-c8b0-4a57-8ffb-7fa1aee0232e", "tag": "2fb5165d-bfbf-4de5-8df3-bb9fe0d27b45"}]} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:58:05.278536 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 04:58:05.278536 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: warnings.warn(msg) Aug 07 04:58:05.285746 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-ec7d6fb6-6c40-4a62-8393-ad732761c712 req-fa06b003-9a89-4123-a07f-d6fa49024829 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:05.286118 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-ec7d6fb6-6c40-4a62-8393-ad732761c712 req-fa06b003-9a89-4123-a07f-d6fa49024829 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:05.297430 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.compute.server_external_events [req-ec7d6fb6-6c40-4a62-8393-ad732761c712 req-fa06b003-9a89-4123-a07f-d6fa49024829 service nova] Creating event network-changed:2fb5165d-bfbf-4de5-8df3-bb9fe0d27b45 for instance 28314017-c8b0-4a57-8ffb-7fa1aee0232e on hv-cinder-80374 Aug 07 04:58:05.302254 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [req-ec7d6fb6-6c40-4a62-8393-ad732761c712 req-fa06b003-9a89-4123-a07f-d6fa49024829 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037881 Aug 07 04:58:05.303064 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 401/755] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 04:58:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:58:05.305958 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-d8608187-cc3d-427d-aca2-0e33f825fea6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:05.314987 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-d8608187-cc3d-427d-aca2-0e33f825fea6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:05.316459 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-d8608187-cc3d-427d-aca2-0e33f825fea6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:05.317629 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-d8608187-cc3d-427d-aca2-0e33f825fea6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1741 microversion: 2.20 time: 0.259984 Aug 07 04:58:05.318173 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 355/756] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:58:05 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1741 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:58:05.809898 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-15bb0066-e9f7-4bc8-b130-a6e93c87ca72 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:05.810870 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-15bb0066-e9f7-4bc8-b130-a6e93c87ca72 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] [instance: 28314017-c8b0-4a57-8ffb-7fa1aee0232e] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:05.817315 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-15bb0066-e9f7-4bc8-b130-a6e93c87ca72 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:05.817818 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-15bb0066-e9f7-4bc8-b130-a6e93c87ca72 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:05.818772 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-15bb0066-e9f7-4bc8-b130-a6e93c87ca72 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:05.819208 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-15bb0066-e9f7-4bc8-b130-a6e93c87ca72 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:05.949999 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-15bb0066-e9f7-4bc8-b130-a6e93c87ca72 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd371b9690a4fe192c4cdf0b4d9900b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5e22820a1410d94c298e75220eb68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:05.957684 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-15bb0066-e9f7-4bc8-b130-a6e93c87ca72 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] 10.222.0.35 "GET /compute/v2.1/servers/28314017-c8b0-4a57-8ffb-7fa1aee0232e" status: 200 len: 1318 microversion: 2.1 time: 0.151754 Aug 07 04:58:05.958683 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 402/757] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:58:05 2021] GET /compute/v2.1/servers/28314017-c8b0-4a57-8ffb-7fa1aee0232e => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:58:06.278803 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-bbd4400e-5368-46d5-93fa-6a2273eecebd tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:06.279514 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-bbd4400e-5368-46d5-93fa-6a2273eecebd tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:06.285760 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-bbd4400e-5368-46d5-93fa-6a2273eecebd tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:06.286266 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-bbd4400e-5368-46d5-93fa-6a2273eecebd tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:06.287122 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-bbd4400e-5368-46d5-93fa-6a2273eecebd tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:06.287723 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-bbd4400e-5368-46d5-93fa-6a2273eecebd tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:06.337422 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-a6b8aba1-335c-480e-952f-f39ced0e19cb tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:06.338769 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-a6b8aba1-335c-480e-952f-f39ced0e19cb tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:06.344473 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a6b8aba1-335c-480e-952f-f39ced0e19cb tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:06.345121 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a6b8aba1-335c-480e-952f-f39ced0e19cb tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:06.345885 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a6b8aba1-335c-480e-952f-f39ced0e19cb tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:06.346308 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a6b8aba1-335c-480e-952f-f39ced0e19cb tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:06.420707 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-bbd4400e-5368-46d5-93fa-6a2273eecebd tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:06.428733 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-bbd4400e-5368-46d5-93fa-6a2273eecebd tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b" status: 200 len: 1512 microversion: 2.1 time: 0.153525 Aug 07 04:58:06.430253 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 356/758] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:58:06 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:58:06.475189 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-a6b8aba1-335c-480e-952f-f39ced0e19cb tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:06.484654 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-a6b8aba1-335c-480e-952f-f39ced0e19cb tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:06.486641 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-a6b8aba1-335c-480e-952f-f39ced0e19cb tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:06.487871 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-a6b8aba1-335c-480e-952f-f39ced0e19cb tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1741 microversion: 2.20 time: 0.155643 Aug 07 04:58:06.488506 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 403/759] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:58:06 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1741 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:58:06.975376 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-ee4a2a71-5c3e-4777-ba60-7c20adb55682 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:06.976037 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-ee4a2a71-5c3e-4777-ba60-7c20adb55682 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] [instance: 28314017-c8b0-4a57-8ffb-7fa1aee0232e] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:06.981835 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ee4a2a71-5c3e-4777-ba60-7c20adb55682 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:06.982302 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ee4a2a71-5c3e-4777-ba60-7c20adb55682 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:06.983093 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ee4a2a71-5c3e-4777-ba60-7c20adb55682 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:06.983552 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ee4a2a71-5c3e-4777-ba60-7c20adb55682 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:07.102782 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-ee4a2a71-5c3e-4777-ba60-7c20adb55682 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd371b9690a4fe192c4cdf0b4d9900b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5e22820a1410d94c298e75220eb68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:07.109963 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-ee4a2a71-5c3e-4777-ba60-7c20adb55682 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] 10.222.0.35 "GET /compute/v2.1/servers/28314017-c8b0-4a57-8ffb-7fa1aee0232e" status: 200 len: 1318 microversion: 2.1 time: 0.138223 Aug 07 04:58:07.110685 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 357/760] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:58:06 2021] GET /compute/v2.1/servers/28314017-c8b0-4a57-8ffb-7fa1aee0232e => generated 1318 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:58:07.447354 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-dde04e0e-7035-40c3-9dbd-c093b36e5eb9 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:07.448137 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-dde04e0e-7035-40c3-9dbd-c093b36e5eb9 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:07.453986 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-dde04e0e-7035-40c3-9dbd-c093b36e5eb9 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:07.454432 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-dde04e0e-7035-40c3-9dbd-c093b36e5eb9 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:07.455209 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-dde04e0e-7035-40c3-9dbd-c093b36e5eb9 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:07.455647 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-dde04e0e-7035-40c3-9dbd-c093b36e5eb9 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:07.506994 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-e64ec13e-e9a4-4a5a-bc52-5fb8a8d26d4c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:07.508322 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-e64ec13e-e9a4-4a5a-bc52-5fb8a8d26d4c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:07.514442 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e64ec13e-e9a4-4a5a-bc52-5fb8a8d26d4c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:07.514968 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e64ec13e-e9a4-4a5a-bc52-5fb8a8d26d4c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:07.515820 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e64ec13e-e9a4-4a5a-bc52-5fb8a8d26d4c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:07.517818 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e64ec13e-e9a4-4a5a-bc52-5fb8a8d26d4c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:07.524871 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-dde04e0e-7035-40c3-9dbd-c093b36e5eb9 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a3194159fb47cdb59335fc442ad6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d51e070d184693b32f62e300ded4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:07.535781 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-dde04e0e-7035-40c3-9dbd-c093b36e5eb9 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b" status: 200 len: 1470 microversion: 2.1 time: 0.092508 Aug 07 04:58:07.545271 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 404/761] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:58:07 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b => generated 1470 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:58:07.591873 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [req-a4d41f1e-dcc7-4fca-8630-91734a242854 req-5e82c346-89d9-4a39-a086-1bf7266d7c6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bba229d-781a-409e-8079-6c9764d8124b", "name": "network-vif-deleted", "tag": "6da7b6cb-d1db-46c0-b902-4f615a911fcf"}]} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:58:07.593464 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 04:58:07.593464 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: warnings.warn(msg) Aug 07 04:58:07.600402 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-a4d41f1e-dcc7-4fca-8630-91734a242854 req-5e82c346-89d9-4a39-a086-1bf7266d7c6b service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:07.601407 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-a4d41f1e-dcc7-4fca-8630-91734a242854 req-5e82c346-89d9-4a39-a086-1bf7266d7c6b service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:07.612672 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.compute.server_external_events [req-a4d41f1e-dcc7-4fca-8630-91734a242854 req-5e82c346-89d9-4a39-a086-1bf7266d7c6b service nova] Creating event network-vif-deleted:6da7b6cb-d1db-46c0-b902-4f615a911fcf for instance 3bba229d-781a-409e-8079-6c9764d8124b on hv-cinder-80374 Aug 07 04:58:07.618461 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [req-a4d41f1e-dcc7-4fca-8630-91734a242854 req-5e82c346-89d9-4a39-a086-1bf7266d7c6b service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030261 Aug 07 04:58:07.619064 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 405/762] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 04:58:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 04:58:07.681050 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-e64ec13e-e9a4-4a5a-bc52-5fb8a8d26d4c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:07.688689 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-e64ec13e-e9a4-4a5a-bc52-5fb8a8d26d4c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:07.690190 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-e64ec13e-e9a4-4a5a-bc52-5fb8a8d26d4c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:07.691316 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-e64ec13e-e9a4-4a5a-bc52-5fb8a8d26d4c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1741 microversion: 2.20 time: 0.188098 Aug 07 04:58:07.691878 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 358/763] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:58:07 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1741 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 04:58:08.127846 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-8c3edea8-6ad8-439a-b83c-925aed6a5b02 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:08.128371 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-8c3edea8-6ad8-439a-b83c-925aed6a5b02 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] [instance: 28314017-c8b0-4a57-8ffb-7fa1aee0232e] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:08.135406 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8c3edea8-6ad8-439a-b83c-925aed6a5b02 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:08.135974 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8c3edea8-6ad8-439a-b83c-925aed6a5b02 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:08.136836 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8c3edea8-6ad8-439a-b83c-925aed6a5b02 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:08.137279 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8c3edea8-6ad8-439a-b83c-925aed6a5b02 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:08.262869 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-8c3edea8-6ad8-439a-b83c-925aed6a5b02 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd371b9690a4fe192c4cdf0b4d9900b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5e22820a1410d94c298e75220eb68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:08.270202 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-8c3edea8-6ad8-439a-b83c-925aed6a5b02 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] 10.222.0.35 "GET /compute/v2.1/servers/28314017-c8b0-4a57-8ffb-7fa1aee0232e" status: 200 len: 1318 microversion: 2.1 time: 0.146932 Aug 07 04:58:08.270765 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 406/764] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:58:08 2021] GET /compute/v2.1/servers/28314017-c8b0-4a57-8ffb-7fa1aee0232e => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:58:08.551369 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-68dd081b-1dbd-4dfa-8728-8d05c4c9e050 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:08.552090 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-68dd081b-1dbd-4dfa-8728-8d05c4c9e050 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] [instance: 3bba229d-781a-409e-8079-6c9764d8124b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:08.559357 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-68dd081b-1dbd-4dfa-8728-8d05c4c9e050 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:08.559831 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-68dd081b-1dbd-4dfa-8728-8d05c4c9e050 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:08.560616 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-68dd081b-1dbd-4dfa-8728-8d05c4c9e050 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:08.561082 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-68dd081b-1dbd-4dfa-8728-8d05c4c9e050 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:08.575790 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.wsgi [None req-68dd081b-1dbd-4dfa-8728-8d05c4c9e050 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] HTTP exception thrown: Instance 3bba229d-781a-409e-8079-6c9764d8124b could not be found. Aug 07 04:58:08.576441 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-68dd081b-1dbd-4dfa-8728-8d05c4c9e050 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] Returning 404 to user: Instance 3bba229d-781a-409e-8079-6c9764d8124b could not be found. {{(pid=107485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 07 04:58:08.577317 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-68dd081b-1dbd-4dfa-8728-8d05c4c9e050 tempest-AttachVolumeNegativeTest-52758057 tempest-AttachVolumeNegativeTest-52758057-project] 10.222.0.35 "GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b" status: 404 len: 111 microversion: 2.1 time: 0.029858 Aug 07 04:58:08.578335 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 359/765] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:58:08 2021] GET /compute/v2.1/servers/3bba229d-781a-409e-8079-6c9764d8124b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 04:58:08.710074 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-d323eb44-849d-4857-b034-d993f8066bf6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:08.711339 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-d323eb44-849d-4857-b034-d993f8066bf6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:08.719357 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d323eb44-849d-4857-b034-d993f8066bf6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:08.720094 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d323eb44-849d-4857-b034-d993f8066bf6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:08.721427 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d323eb44-849d-4857-b034-d993f8066bf6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:08.722073 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d323eb44-849d-4857-b034-d993f8066bf6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:09.226564 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-d323eb44-849d-4857-b034-d993f8066bf6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:09.236259 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-d323eb44-849d-4857-b034-d993f8066bf6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:09.237979 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-d323eb44-849d-4857-b034-d993f8066bf6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:09.239305 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-d323eb44-849d-4857-b034-d993f8066bf6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1736 microversion: 2.20 time: 0.533782 Aug 07 04:58:09.251818 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 407/766] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:58:08 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1736 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 04:58:09.287374 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-0cb9e062-42f7-47fe-a13d-cee1b3382f0d tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:09.288117 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-0cb9e062-42f7-47fe-a13d-cee1b3382f0d tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] [instance: 28314017-c8b0-4a57-8ffb-7fa1aee0232e] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:09.295333 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0cb9e062-42f7-47fe-a13d-cee1b3382f0d tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:09.296102 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0cb9e062-42f7-47fe-a13d-cee1b3382f0d tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:09.297015 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0cb9e062-42f7-47fe-a13d-cee1b3382f0d tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:09.297511 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0cb9e062-42f7-47fe-a13d-cee1b3382f0d tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:09.447871 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-0cb9e062-42f7-47fe-a13d-cee1b3382f0d tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd371b9690a4fe192c4cdf0b4d9900b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5e22820a1410d94c298e75220eb68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:09.458111 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-0cb9e062-42f7-47fe-a13d-cee1b3382f0d tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] 10.222.0.35 "GET /compute/v2.1/servers/28314017-c8b0-4a57-8ffb-7fa1aee0232e" status: 200 len: 1318 microversion: 2.1 time: 0.174516 Aug 07 04:58:09.459258 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 360/767] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:58:09 2021] GET /compute/v2.1/servers/28314017-c8b0-4a57-8ffb-7fa1aee0232e => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:58:10.257905 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-5b81c956-250e-4a45-ab4b-16a72ed91195 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:10.259661 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-5b81c956-250e-4a45-ab4b-16a72ed91195 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:10.275632 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5b81c956-250e-4a45-ab4b-16a72ed91195 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:10.276538 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5b81c956-250e-4a45-ab4b-16a72ed91195 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:10.281032 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5b81c956-250e-4a45-ab4b-16a72ed91195 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:10.281032 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5b81c956-250e-4a45-ab4b-16a72ed91195 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:10.433491 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-5b81c956-250e-4a45-ab4b-16a72ed91195 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:10.448209 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-5b81c956-250e-4a45-ab4b-16a72ed91195 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:10.450606 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-5b81c956-250e-4a45-ab4b-16a72ed91195 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:10.452486 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-5b81c956-250e-4a45-ab4b-16a72ed91195 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1736 microversion: 2.20 time: 0.197910 Aug 07 04:58:10.454075 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 408/768] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:58:10 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1736 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:58:10.475271 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-2ae8c5a3-d759-4b9d-b397-5930c2852ff6 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:10.475979 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-2ae8c5a3-d759-4b9d-b397-5930c2852ff6 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] [instance: 28314017-c8b0-4a57-8ffb-7fa1aee0232e] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:10.482018 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2ae8c5a3-d759-4b9d-b397-5930c2852ff6 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:10.482551 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2ae8c5a3-d759-4b9d-b397-5930c2852ff6 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:10.483680 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2ae8c5a3-d759-4b9d-b397-5930c2852ff6 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:10.484327 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2ae8c5a3-d759-4b9d-b397-5930c2852ff6 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:10.649914 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-2ae8c5a3-d759-4b9d-b397-5930c2852ff6 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd371b9690a4fe192c4cdf0b4d9900b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5e22820a1410d94c298e75220eb68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:10.658658 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-2ae8c5a3-d759-4b9d-b397-5930c2852ff6 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] 10.222.0.35 "GET /compute/v2.1/servers/28314017-c8b0-4a57-8ffb-7fa1aee0232e" status: 200 len: 1318 microversion: 2.1 time: 0.187114 Aug 07 04:58:10.659869 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 361/769] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:58:10 2021] GET /compute/v2.1/servers/28314017-c8b0-4a57-8ffb-7fa1aee0232e => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:58:11.471091 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-72ea0178-297b-482c-b9f1-6f5292bbf3ef tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:11.471702 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-72ea0178-297b-482c-b9f1-6f5292bbf3ef tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:11.484460 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-72ea0178-297b-482c-b9f1-6f5292bbf3ef tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:11.486417 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-72ea0178-297b-482c-b9f1-6f5292bbf3ef tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:11.487765 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-72ea0178-297b-482c-b9f1-6f5292bbf3ef tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:11.488638 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-72ea0178-297b-482c-b9f1-6f5292bbf3ef tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:11.639828 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-72ea0178-297b-482c-b9f1-6f5292bbf3ef tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:11.648673 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-72ea0178-297b-482c-b9f1-6f5292bbf3ef tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:11.652445 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-72ea0178-297b-482c-b9f1-6f5292bbf3ef tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:11.653995 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-72ea0178-297b-482c-b9f1-6f5292bbf3ef tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1736 microversion: 2.20 time: 0.186542 Aug 07 04:58:11.655155 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 409/770] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:58:11 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1736 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:58:11.676548 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-769aa64a-e382-4eb4-8891-a85c47612f81 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:11.679278 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-769aa64a-e382-4eb4-8891-a85c47612f81 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] [instance: 28314017-c8b0-4a57-8ffb-7fa1aee0232e] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:11.689741 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-769aa64a-e382-4eb4-8891-a85c47612f81 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:11.690542 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-769aa64a-e382-4eb4-8891-a85c47612f81 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:11.691620 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-769aa64a-e382-4eb4-8891-a85c47612f81 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:11.692269 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-769aa64a-e382-4eb4-8891-a85c47612f81 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:11.918918 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-769aa64a-e382-4eb4-8891-a85c47612f81 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd371b9690a4fe192c4cdf0b4d9900b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5e22820a1410d94c298e75220eb68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:11.929823 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-769aa64a-e382-4eb4-8891-a85c47612f81 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] 10.222.0.35 "GET /compute/v2.1/servers/28314017-c8b0-4a57-8ffb-7fa1aee0232e" status: 200 len: 1318 microversion: 2.1 time: 0.256845 Aug 07 04:58:11.933832 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 362/771] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:58:11 2021] GET /compute/v2.1/servers/28314017-c8b0-4a57-8ffb-7fa1aee0232e => generated 1318 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:58:12.671763 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-204f03e3-0ea0-427d-860b-c6339d5c1a8f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:12.672372 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-204f03e3-0ea0-427d-860b-c6339d5c1a8f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:12.679040 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-204f03e3-0ea0-427d-860b-c6339d5c1a8f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:12.679723 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-204f03e3-0ea0-427d-860b-c6339d5c1a8f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:12.681522 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-204f03e3-0ea0-427d-860b-c6339d5c1a8f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:12.682128 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-204f03e3-0ea0-427d-860b-c6339d5c1a8f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:12.893346 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-204f03e3-0ea0-427d-860b-c6339d5c1a8f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:12.903191 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-204f03e3-0ea0-427d-860b-c6339d5c1a8f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:12.904968 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-204f03e3-0ea0-427d-860b-c6339d5c1a8f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:12.906614 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-204f03e3-0ea0-427d-860b-c6339d5c1a8f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1736 microversion: 2.20 time: 0.238451 Aug 07 04:58:12.907352 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 410/772] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:58:12 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1736 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 04:58:12.948025 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-392dfaf9-37fe-4914-898b-8d0c1382395d tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:12.948962 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-392dfaf9-37fe-4914-898b-8d0c1382395d tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] [instance: 28314017-c8b0-4a57-8ffb-7fa1aee0232e] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:12.955363 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-392dfaf9-37fe-4914-898b-8d0c1382395d tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:12.955954 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-392dfaf9-37fe-4914-898b-8d0c1382395d tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:12.957067 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-392dfaf9-37fe-4914-898b-8d0c1382395d tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:12.957584 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-392dfaf9-37fe-4914-898b-8d0c1382395d tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:13.137658 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-392dfaf9-37fe-4914-898b-8d0c1382395d tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd371b9690a4fe192c4cdf0b4d9900b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5e22820a1410d94c298e75220eb68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:13.145225 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-392dfaf9-37fe-4914-898b-8d0c1382395d tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] 10.222.0.35 "GET /compute/v2.1/servers/28314017-c8b0-4a57-8ffb-7fa1aee0232e" status: 200 len: 1318 microversion: 2.1 time: 0.201524 Aug 07 04:58:13.155254 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 363/773] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:58:12 2021] GET /compute/v2.1/servers/28314017-c8b0-4a57-8ffb-7fa1aee0232e => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:58:13.747605 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [req-826513df-13c5-42c7-9896-951746008194 req-afd140a1-47a9-4b0c-a4e2-25ee8df1f7bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28314017-c8b0-4a57-8ffb-7fa1aee0232e", "name": "network-vif-plugged", "status": "completed", "tag": "2fb5165d-bfbf-4de5-8df3-bb9fe0d27b45"}]} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:58:13.751896 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 04:58:13.751896 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: warnings.warn(msg) Aug 07 04:58:13.760577 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-826513df-13c5-42c7-9896-951746008194 req-afd140a1-47a9-4b0c-a4e2-25ee8df1f7bb service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:13.761294 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-826513df-13c5-42c7-9896-951746008194 req-afd140a1-47a9-4b0c-a4e2-25ee8df1f7bb service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:13.798649 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.compute.server_external_events [req-826513df-13c5-42c7-9896-951746008194 req-afd140a1-47a9-4b0c-a4e2-25ee8df1f7bb service nova] Creating event network-vif-plugged:2fb5165d-bfbf-4de5-8df3-bb9fe0d27b45 for instance 28314017-c8b0-4a57-8ffb-7fa1aee0232e on hv-cinder-80374 Aug 07 04:58:13.810495 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [req-826513df-13c5-42c7-9896-951746008194 req-afd140a1-47a9-4b0c-a4e2-25ee8df1f7bb service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065638 Aug 07 04:58:13.811673 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 411/774] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 04:58:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:58:13.928225 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-f38ca95b-f840-460d-9181-fa74ac38ba48 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:13.929327 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-f38ca95b-f840-460d-9181-fa74ac38ba48 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:13.942794 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f38ca95b-f840-460d-9181-fa74ac38ba48 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:13.945046 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f38ca95b-f840-460d-9181-fa74ac38ba48 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:13.946198 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f38ca95b-f840-460d-9181-fa74ac38ba48 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:13.950591 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f38ca95b-f840-460d-9181-fa74ac38ba48 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:14.053265 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-554e9f37-5a3a-43aa-80fa-dab5985c772f tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1257804171", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-516936065", "security_groups": [{"name": "tempest-secgroup-smoke-294899075"}], "networks": [{"uuid": "c61f287c-7f72-4059-8f75-007b2e5d7520"}], "block_device_mapping_v2": [{"uuid": "fba04911-0544-449e-834e-b462072b8f3c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:58:14.195469 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.network.neutron [None req-554e9f37-5a3a-43aa-80fa-dab5985c772f tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] validate_networks() for [('c61f287c-7f72-4059-8f75-007b2e5d7520', None, None, None)] {{(pid=107486) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 07 04:58:14.241955 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-f38ca95b-f840-460d-9181-fa74ac38ba48 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:14.253917 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-f38ca95b-f840-460d-9181-fa74ac38ba48 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:14.260616 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-f38ca95b-f840-460d-9181-fa74ac38ba48 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:14.262590 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-f38ca95b-f840-460d-9181-fa74ac38ba48 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1736 microversion: 2.20 time: 0.338481 Aug 07 04:58:14.265464 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 364/775] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:58:13 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1736 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:58:14.270551 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-ddf7d75e-ead6-463d-a33c-1d7603015d10 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:14.271415 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-ddf7d75e-ead6-463d-a33c-1d7603015d10 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] [instance: 28314017-c8b0-4a57-8ffb-7fa1aee0232e] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:14.278433 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ddf7d75e-ead6-463d-a33c-1d7603015d10 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:14.279793 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ddf7d75e-ead6-463d-a33c-1d7603015d10 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:14.281528 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ddf7d75e-ead6-463d-a33c-1d7603015d10 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:14.282383 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ddf7d75e-ead6-463d-a33c-1d7603015d10 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:14.485682 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-ddf7d75e-ead6-463d-a33c-1d7603015d10 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd371b9690a4fe192c4cdf0b4d9900b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5e22820a1410d94c298e75220eb68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:14.496733 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-ddf7d75e-ead6-463d-a33c-1d7603015d10 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] 10.222.0.35 "GET /compute/v2.1/servers/28314017-c8b0-4a57-8ffb-7fa1aee0232e" status: 200 len: 1318 microversion: 2.1 time: 0.229915 Aug 07 04:58:14.499211 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 365/776] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:58:14 2021] GET /compute/v2.1/servers/28314017-c8b0-4a57-8ffb-7fa1aee0232e => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:58:14.740337 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.virt.hardware [None req-554e9f37-5a3a-43aa-80fa-dab5985c772f tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Flavor limits 0:0:0 {{(pid=107486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 04:58:14.740958 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.virt.hardware [None req-554e9f37-5a3a-43aa-80fa-dab5985c772f tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Image limits 0:0:0 {{(pid=107486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 04:58:14.741545 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.virt.hardware [None req-554e9f37-5a3a-43aa-80fa-dab5985c772f tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Flavor pref 0:0:0 {{(pid=107486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 04:58:14.742232 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.virt.hardware [None req-554e9f37-5a3a-43aa-80fa-dab5985c772f tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Image pref 0:0:0 {{(pid=107486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 04:58:14.743395 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.virt.hardware [None req-554e9f37-5a3a-43aa-80fa-dab5985c772f tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 04:58:14.755501 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-554e9f37-5a3a-43aa-80fa-dab5985c772f tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:14.756936 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-554e9f37-5a3a-43aa-80fa-dab5985c772f tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:14.758827 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-554e9f37-5a3a-43aa-80fa-dab5985c772f tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:14.759513 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-554e9f37-5a3a-43aa-80fa-dab5985c772f tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:14.779539 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.quota [None req-554e9f37-5a3a-43aa-80fa-dab5985c772f tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Getting quotas for project 9874042788a343ec976046e4394fa45e. Resources: {'ram', 'cores', 'instances'} {{(pid=107486) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 07 04:58:14.783892 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.quota [None req-554e9f37-5a3a-43aa-80fa-dab5985c772f tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Getting quotas for user 9fec41eb8ba14082b33f628c86fe48c8 and project 9874042788a343ec976046e4394fa45e. Resources: {'ram', 'cores', 'instances'} {{(pid=107486) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 07 04:58:14.879073 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-554e9f37-5a3a-43aa-80fa-dab5985c772f tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Going to run 1 instances... {{(pid=107486) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 07 04:58:14.881490 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-554e9f37-5a3a-43aa-80fa-dab5985c772f tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] [instance: c0921101-facb-43a4-addf-1c9791448743] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fba04911-0544-449e-834e-b462072b8f3c',volume_size=None,volume_type=None)] {{(pid=107486) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 07 04:58:15.066419 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-554e9f37-5a3a-43aa-80fa-dab5985c772f tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.016993 Aug 07 04:58:15.073280 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 412/777] 10.222.0.35 () {60 vars in 1147 bytes} [Sat Aug 7 04:58:14 2021] POST /compute/v2.1/servers => generated 405 bytes in 1025 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 04:58:15.079487 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-e3e3494b-aca1-4080-847f-f6107d65f1a3 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:15.080852 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-e3e3494b-aca1-4080-847f-f6107d65f1a3 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] [instance: c0921101-facb-43a4-addf-1c9791448743] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:15.206312 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-e3e3494b-aca1-4080-847f-f6107d65f1a3 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fec41eb8ba14082b33f628c86fe48c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874042788a343ec976046e4394fa45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:15.213893 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-e3e3494b-aca1-4080-847f-f6107d65f1a3 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] 10.222.0.35 "GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743" status: 200 len: 1088 microversion: 2.1 time: 0.139534 Aug 07 04:58:15.217484 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 366/778] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:58:15 2021] GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743 => generated 1088 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:58:15.283264 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-e50cd302-6d5e-4660-91de-9275b02e591b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:15.283992 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-e50cd302-6d5e-4660-91de-9275b02e591b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:15.302828 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e50cd302-6d5e-4660-91de-9275b02e591b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:15.303325 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e50cd302-6d5e-4660-91de-9275b02e591b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:15.304091 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e50cd302-6d5e-4660-91de-9275b02e591b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:15.304535 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e50cd302-6d5e-4660-91de-9275b02e591b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:15.517319 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-31a290b0-5618-47f9-8320-c4f4fefc9706 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:15.518111 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-31a290b0-5618-47f9-8320-c4f4fefc9706 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] [instance: 28314017-c8b0-4a57-8ffb-7fa1aee0232e] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:15.530892 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-31a290b0-5618-47f9-8320-c4f4fefc9706 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:15.531565 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-31a290b0-5618-47f9-8320-c4f4fefc9706 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:15.532392 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-31a290b0-5618-47f9-8320-c4f4fefc9706 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:15.538181 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-31a290b0-5618-47f9-8320-c4f4fefc9706 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:15.560667 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-e50cd302-6d5e-4660-91de-9275b02e591b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:15.571297 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-e50cd302-6d5e-4660-91de-9275b02e591b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:15.579565 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-e50cd302-6d5e-4660-91de-9275b02e591b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:15.580827 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-e50cd302-6d5e-4660-91de-9275b02e591b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1736 microversion: 2.20 time: 0.302065 Aug 07 04:58:15.581409 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 413/779] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:58:15 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1736 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 04:58:15.896036 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-31a290b0-5618-47f9-8320-c4f4fefc9706 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd371b9690a4fe192c4cdf0b4d9900b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5e22820a1410d94c298e75220eb68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:15.916149 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-31a290b0-5618-47f9-8320-c4f4fefc9706 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] 10.222.0.35 "GET /compute/v2.1/servers/28314017-c8b0-4a57-8ffb-7fa1aee0232e" status: 200 len: 1318 microversion: 2.1 time: 0.402722 Aug 07 04:58:15.919767 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 367/780] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:58:15 2021] GET /compute/v2.1/servers/28314017-c8b0-4a57-8ffb-7fa1aee0232e => generated 1318 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:58:16.235525 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-47e14241-c801-4a3d-83d0-f5519e983ab6 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:16.237164 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-47e14241-c801-4a3d-83d0-f5519e983ab6 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] [instance: c0921101-facb-43a4-addf-1c9791448743] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:16.250425 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-47e14241-c801-4a3d-83d0-f5519e983ab6 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:16.252040 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-47e14241-c801-4a3d-83d0-f5519e983ab6 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:16.256959 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-47e14241-c801-4a3d-83d0-f5519e983ab6 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:16.257694 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-47e14241-c801-4a3d-83d0-f5519e983ab6 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:16.377848 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-47e14241-c801-4a3d-83d0-f5519e983ab6 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fec41eb8ba14082b33f628c86fe48c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874042788a343ec976046e4394fa45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:16.387773 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-47e14241-c801-4a3d-83d0-f5519e983ab6 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] 10.222.0.35 "GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743" status: 200 len: 1186 microversion: 2.1 time: 0.155088 Aug 07 04:58:16.389484 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 414/781] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:58:16 2021] GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743 => generated 1186 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:58:16.601903 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-fd93dec0-cd5c-42ef-b987-fd906526b252 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:16.604000 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-fd93dec0-cd5c-42ef-b987-fd906526b252 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:16.611105 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-fd93dec0-cd5c-42ef-b987-fd906526b252 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:16.611924 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-fd93dec0-cd5c-42ef-b987-fd906526b252 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:16.613281 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-fd93dec0-cd5c-42ef-b987-fd906526b252 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:16.614090 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-fd93dec0-cd5c-42ef-b987-fd906526b252 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:16.935961 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-39133e9c-cfc5-483c-9d37-7d67f1c6b2e3 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:16.936667 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-39133e9c-cfc5-483c-9d37-7d67f1c6b2e3 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] [instance: 28314017-c8b0-4a57-8ffb-7fa1aee0232e] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:16.948867 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-39133e9c-cfc5-483c-9d37-7d67f1c6b2e3 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:16.949631 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-39133e9c-cfc5-483c-9d37-7d67f1c6b2e3 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:16.951002 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-39133e9c-cfc5-483c-9d37-7d67f1c6b2e3 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:16.951253 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-39133e9c-cfc5-483c-9d37-7d67f1c6b2e3 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:17.064246 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-fd93dec0-cd5c-42ef-b987-fd906526b252 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:17.075974 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-fd93dec0-cd5c-42ef-b987-fd906526b252 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:17.077948 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-fd93dec0-cd5c-42ef-b987-fd906526b252 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:17.079161 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-fd93dec0-cd5c-42ef-b987-fd906526b252 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1736 microversion: 2.20 time: 0.482404 Aug 07 04:58:17.084556 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 368/782] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:58:16 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1736 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:58:17.294492 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-39133e9c-cfc5-483c-9d37-7d67f1c6b2e3 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd371b9690a4fe192c4cdf0b4d9900b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5e22820a1410d94c298e75220eb68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:17.323075 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-39133e9c-cfc5-483c-9d37-7d67f1c6b2e3 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] 10.222.0.35 "GET /compute/v2.1/servers/28314017-c8b0-4a57-8ffb-7fa1aee0232e" status: 200 len: 1506 microversion: 2.1 time: 0.390491 Aug 07 04:58:17.325519 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 415/783] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:58:16 2021] GET /compute/v2.1/servers/28314017-c8b0-4a57-8ffb-7fa1aee0232e => generated 1506 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:58:17.405758 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-0180b49f-f5ed-4629-a489-d24b3061f64c tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:17.409371 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-0180b49f-f5ed-4629-a489-d24b3061f64c tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] [instance: c0921101-facb-43a4-addf-1c9791448743] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:17.431271 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0180b49f-f5ed-4629-a489-d24b3061f64c tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:17.435655 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0180b49f-f5ed-4629-a489-d24b3061f64c tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:17.437618 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0180b49f-f5ed-4629-a489-d24b3061f64c tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:17.442761 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0180b49f-f5ed-4629-a489-d24b3061f64c tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:17.817053 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-0180b49f-f5ed-4629-a489-d24b3061f64c tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fec41eb8ba14082b33f628c86fe48c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874042788a343ec976046e4394fa45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:17.836718 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-0180b49f-f5ed-4629-a489-d24b3061f64c tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] 10.222.0.35 "GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743" status: 200 len: 1204 microversion: 2.1 time: 0.433913 Aug 07 04:58:17.844817 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 369/784] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:58:17 2021] GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743 => generated 1204 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:58:18.105606 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-d56d7157-f301-49a5-a16b-4d47913dce08 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:18.106338 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-d56d7157-f301-49a5-a16b-4d47913dce08 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:18.120037 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d56d7157-f301-49a5-a16b-4d47913dce08 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:18.122457 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d56d7157-f301-49a5-a16b-4d47913dce08 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:18.124940 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d56d7157-f301-49a5-a16b-4d47913dce08 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:18.127052 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d56d7157-f301-49a5-a16b-4d47913dce08 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:18.491155 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-d56d7157-f301-49a5-a16b-4d47913dce08 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:18.503131 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-d56d7157-f301-49a5-a16b-4d47913dce08 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:18.514844 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-d56d7157-f301-49a5-a16b-4d47913dce08 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:18.516154 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-d56d7157-f301-49a5-a16b-4d47913dce08 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1736 microversion: 2.20 time: 0.416038 Aug 07 04:58:18.516844 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 416/785] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:58:18 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1736 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:58:18.863742 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-a3528636-9ca4-4a2c-9fa3-e53a506d993a tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:18.864453 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-a3528636-9ca4-4a2c-9fa3-e53a506d993a tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] [instance: c0921101-facb-43a4-addf-1c9791448743] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:18.874637 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a3528636-9ca4-4a2c-9fa3-e53a506d993a tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:18.877405 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a3528636-9ca4-4a2c-9fa3-e53a506d993a tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:18.878386 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a3528636-9ca4-4a2c-9fa3-e53a506d993a tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:18.878989 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a3528636-9ca4-4a2c-9fa3-e53a506d993a tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:19.513373 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-a3528636-9ca4-4a2c-9fa3-e53a506d993a tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fec41eb8ba14082b33f628c86fe48c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874042788a343ec976046e4394fa45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:19.520906 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-a3528636-9ca4-4a2c-9fa3-e53a506d993a tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] 10.222.0.35 "GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743" status: 200 len: 1259 microversion: 2.1 time: 0.662603 Aug 07 04:58:19.521982 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 370/786] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:58:18 2021] GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743 => generated 1259 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:58:19.538315 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-44380f4f-f40b-4fb5-bd0c-dc9b66fe3c31 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:19.539662 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-44380f4f-f40b-4fb5-bd0c-dc9b66fe3c31 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:19.547561 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-44380f4f-f40b-4fb5-bd0c-dc9b66fe3c31 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:19.548357 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-44380f4f-f40b-4fb5-bd0c-dc9b66fe3c31 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:19.549498 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-44380f4f-f40b-4fb5-bd0c-dc9b66fe3c31 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:19.550280 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-44380f4f-f40b-4fb5-bd0c-dc9b66fe3c31 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:19.741111 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-44380f4f-f40b-4fb5-bd0c-dc9b66fe3c31 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:19.751976 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-44380f4f-f40b-4fb5-bd0c-dc9b66fe3c31 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:19.753882 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-44380f4f-f40b-4fb5-bd0c-dc9b66fe3c31 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:19.759304 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-44380f4f-f40b-4fb5-bd0c-dc9b66fe3c31 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1736 microversion: 2.20 time: 0.228676 Aug 07 04:58:19.760459 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 417/787] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:58:19 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1736 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:58:20.099709 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [req-4baa9fc6-f399-43fa-a8c0-192a1cb247a9 req-cc9b1313-0758-4c87-b41c-5f63e23a4fc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0921101-facb-43a4-addf-1c9791448743", "tag": "018d5d66-f848-4b34-9a5e-9f813a6e1b80"}]} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:58:20.101340 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 04:58:20.101340 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: warnings.warn(msg) Aug 07 04:58:20.126279 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-4baa9fc6-f399-43fa-a8c0-192a1cb247a9 req-cc9b1313-0758-4c87-b41c-5f63e23a4fc2 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:20.129623 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-4baa9fc6-f399-43fa-a8c0-192a1cb247a9 req-cc9b1313-0758-4c87-b41c-5f63e23a4fc2 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:20.160493 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.compute.server_external_events [req-4baa9fc6-f399-43fa-a8c0-192a1cb247a9 req-cc9b1313-0758-4c87-b41c-5f63e23a4fc2 service nova] Creating event network-changed:018d5d66-f848-4b34-9a5e-9f813a6e1b80 for instance c0921101-facb-43a4-addf-1c9791448743 on hv-cinder-80374 Aug 07 04:58:20.168593 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [req-4baa9fc6-f399-43fa-a8c0-192a1cb247a9 req-cc9b1313-0758-4c87-b41c-5f63e23a4fc2 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072399 Aug 07 04:58:20.169225 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 371/788] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 04:58:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:58:20.542372 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-9d800769-f1b6-4734-b5d3-9ca6c7cdd6a5 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:20.543617 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-9d800769-f1b6-4734-b5d3-9ca6c7cdd6a5 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] [instance: c0921101-facb-43a4-addf-1c9791448743] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:20.558850 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9d800769-f1b6-4734-b5d3-9ca6c7cdd6a5 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:20.559165 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9d800769-f1b6-4734-b5d3-9ca6c7cdd6a5 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:20.560079 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9d800769-f1b6-4734-b5d3-9ca6c7cdd6a5 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:20.565951 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9d800769-f1b6-4734-b5d3-9ca6c7cdd6a5 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:20.781118 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-9d800769-f1b6-4734-b5d3-9ca6c7cdd6a5 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fec41eb8ba14082b33f628c86fe48c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874042788a343ec976046e4394fa45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:20.784098 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-4b47ae2b-8f91-4c24-a632-db5013a7f88b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:20.785374 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-4b47ae2b-8f91-4c24-a632-db5013a7f88b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:20.790142 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-9d800769-f1b6-4734-b5d3-9ca6c7cdd6a5 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] 10.222.0.35 "GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743" status: 200 len: 1259 microversion: 2.1 time: 0.252240 Aug 07 04:58:20.798797 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4b47ae2b-8f91-4c24-a632-db5013a7f88b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:20.799429 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4b47ae2b-8f91-4c24-a632-db5013a7f88b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:20.801792 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 418/789] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:58:20 2021] GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743 => generated 1259 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:58:20.803021 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4b47ae2b-8f91-4c24-a632-db5013a7f88b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:20.803496 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4b47ae2b-8f91-4c24-a632-db5013a7f88b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:21.042101 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-4b47ae2b-8f91-4c24-a632-db5013a7f88b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:21.052514 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-4b47ae2b-8f91-4c24-a632-db5013a7f88b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:21.060624 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-4b47ae2b-8f91-4c24-a632-db5013a7f88b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:21.061871 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-4b47ae2b-8f91-4c24-a632-db5013a7f88b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1736 microversion: 2.20 time: 0.287511 Aug 07 04:58:21.062658 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 372/790] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:58:20 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1736 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 04:58:21.807425 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-679325e6-08a9-4830-bd00-889eeb737e45 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:21.808027 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-679325e6-08a9-4830-bd00-889eeb737e45 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] [instance: c0921101-facb-43a4-addf-1c9791448743] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:21.816886 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-679325e6-08a9-4830-bd00-889eeb737e45 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:21.817341 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-679325e6-08a9-4830-bd00-889eeb737e45 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:21.818146 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-679325e6-08a9-4830-bd00-889eeb737e45 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:21.818811 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-679325e6-08a9-4830-bd00-889eeb737e45 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:21.974005 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-679325e6-08a9-4830-bd00-889eeb737e45 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fec41eb8ba14082b33f628c86fe48c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874042788a343ec976046e4394fa45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:21.983037 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-679325e6-08a9-4830-bd00-889eeb737e45 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] 10.222.0.35 "GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743" status: 200 len: 1259 microversion: 2.1 time: 0.179721 Aug 07 04:58:21.983220 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 419/791] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:58:21 2021] GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743 => generated 1259 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:58:22.082333 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-718c337d-bd2f-4334-9da2-6b5671aed711 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:22.083766 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-718c337d-bd2f-4334-9da2-6b5671aed711 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:22.095822 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-718c337d-bd2f-4334-9da2-6b5671aed711 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:22.096577 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-718c337d-bd2f-4334-9da2-6b5671aed711 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:22.097603 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-718c337d-bd2f-4334-9da2-6b5671aed711 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:22.098226 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-718c337d-bd2f-4334-9da2-6b5671aed711 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:22.290538 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-718c337d-bd2f-4334-9da2-6b5671aed711 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:22.299557 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-718c337d-bd2f-4334-9da2-6b5671aed711 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:22.301411 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-718c337d-bd2f-4334-9da2-6b5671aed711 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:22.302829 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-718c337d-bd2f-4334-9da2-6b5671aed711 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1736 microversion: 2.20 time: 0.224312 Aug 07 04:58:22.314389 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 373/792] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:58:22 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1736 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:58:23.001428 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-db52fce0-2f2c-4458-ac14-b252a90d55d2 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:23.002885 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-db52fce0-2f2c-4458-ac14-b252a90d55d2 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] [instance: c0921101-facb-43a4-addf-1c9791448743] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:23.013182 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-db52fce0-2f2c-4458-ac14-b252a90d55d2 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:23.014152 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-db52fce0-2f2c-4458-ac14-b252a90d55d2 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:23.015452 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-db52fce0-2f2c-4458-ac14-b252a90d55d2 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:23.016067 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-db52fce0-2f2c-4458-ac14-b252a90d55d2 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:23.147176 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-db52fce0-2f2c-4458-ac14-b252a90d55d2 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fec41eb8ba14082b33f628c86fe48c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874042788a343ec976046e4394fa45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:23.154763 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-db52fce0-2f2c-4458-ac14-b252a90d55d2 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] 10.222.0.35 "GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743" status: 200 len: 1259 microversion: 2.1 time: 0.158777 Aug 07 04:58:23.155597 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 420/793] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:58:22 2021] GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:58:23.321717 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-3e731281-a9c4-45aa-ac87-be1c080380d1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:23.322358 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-3e731281-a9c4-45aa-ac87-be1c080380d1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:23.328109 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3e731281-a9c4-45aa-ac87-be1c080380d1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:23.328553 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3e731281-a9c4-45aa-ac87-be1c080380d1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:23.329354 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3e731281-a9c4-45aa-ac87-be1c080380d1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:23.329785 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3e731281-a9c4-45aa-ac87-be1c080380d1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:23.456548 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-3e731281-a9c4-45aa-ac87-be1c080380d1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:23.465139 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-3e731281-a9c4-45aa-ac87-be1c080380d1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:23.466620 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-3e731281-a9c4-45aa-ac87-be1c080380d1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:23.467736 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-3e731281-a9c4-45aa-ac87-be1c080380d1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1736 microversion: 2.20 time: 0.150328 Aug 07 04:58:23.468653 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 374/794] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:58:23 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:58:24.172346 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-e3fa56dd-8ffc-4ef1-9693-ea123b551a3d tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:24.175328 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-e3fa56dd-8ffc-4ef1-9693-ea123b551a3d tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] [instance: c0921101-facb-43a4-addf-1c9791448743] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:24.184112 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e3fa56dd-8ffc-4ef1-9693-ea123b551a3d tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:24.184831 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e3fa56dd-8ffc-4ef1-9693-ea123b551a3d tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:24.185828 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e3fa56dd-8ffc-4ef1-9693-ea123b551a3d tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:24.186424 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e3fa56dd-8ffc-4ef1-9693-ea123b551a3d tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:24.318175 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-e3fa56dd-8ffc-4ef1-9693-ea123b551a3d tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fec41eb8ba14082b33f628c86fe48c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874042788a343ec976046e4394fa45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:24.330194 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-e3fa56dd-8ffc-4ef1-9693-ea123b551a3d tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] 10.222.0.35 "GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743" status: 200 len: 1259 microversion: 2.1 time: 0.161422 Aug 07 04:58:24.330194 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 421/795] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:58:24 2021] GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:58:24.485520 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-df854b45-70da-4316-8718-c11b75685e0c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:24.486325 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-df854b45-70da-4316-8718-c11b75685e0c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:24.492435 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-df854b45-70da-4316-8718-c11b75685e0c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:24.493050 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-df854b45-70da-4316-8718-c11b75685e0c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:24.493991 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-df854b45-70da-4316-8718-c11b75685e0c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:24.494515 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-df854b45-70da-4316-8718-c11b75685e0c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:24.739032 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-df854b45-70da-4316-8718-c11b75685e0c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:24.747607 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-df854b45-70da-4316-8718-c11b75685e0c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:24.749118 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-df854b45-70da-4316-8718-c11b75685e0c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:24.750249 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-df854b45-70da-4316-8718-c11b75685e0c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1718 microversion: 2.20 time: 0.268542 Aug 07 04:58:24.750790 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 375/796] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:58:24 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1718 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:58:25.353402 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-0a4adabc-3f57-40e2-93a8-cf6cc43031ac tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:25.354009 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-0a4adabc-3f57-40e2-93a8-cf6cc43031ac tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] [instance: c0921101-facb-43a4-addf-1c9791448743] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:25.361529 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0a4adabc-3f57-40e2-93a8-cf6cc43031ac tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:25.361979 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0a4adabc-3f57-40e2-93a8-cf6cc43031ac tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:25.362766 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0a4adabc-3f57-40e2-93a8-cf6cc43031ac tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:25.363237 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0a4adabc-3f57-40e2-93a8-cf6cc43031ac tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:25.513222 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-0a4adabc-3f57-40e2-93a8-cf6cc43031ac tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fec41eb8ba14082b33f628c86fe48c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874042788a343ec976046e4394fa45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:25.525778 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-0a4adabc-3f57-40e2-93a8-cf6cc43031ac tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] 10.222.0.35 "GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743" status: 200 len: 1259 microversion: 2.1 time: 0.176361 Aug 07 04:58:25.526565 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 422/797] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:58:25 2021] GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743 => generated 1259 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:58:25.769508 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-093dc7a3-6cc6-4df2-96a1-11a432da2cc8 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:25.770044 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-093dc7a3-6cc6-4df2-96a1-11a432da2cc8 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:25.777103 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-093dc7a3-6cc6-4df2-96a1-11a432da2cc8 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:25.777645 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-093dc7a3-6cc6-4df2-96a1-11a432da2cc8 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:25.778489 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-093dc7a3-6cc6-4df2-96a1-11a432da2cc8 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:25.778979 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-093dc7a3-6cc6-4df2-96a1-11a432da2cc8 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:25.932909 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-093dc7a3-6cc6-4df2-96a1-11a432da2cc8 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:25.947908 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-093dc7a3-6cc6-4df2-96a1-11a432da2cc8 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:25.950592 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-093dc7a3-6cc6-4df2-96a1-11a432da2cc8 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:25.952580 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-093dc7a3-6cc6-4df2-96a1-11a432da2cc8 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1718 microversion: 2.20 time: 0.186615 Aug 07 04:58:25.953525 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 376/798] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:58:25 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1718 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:58:26.544571 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-ad0b024b-a501-42b7-89f9-5666914ef917 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:26.544571 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-ad0b024b-a501-42b7-89f9-5666914ef917 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] [instance: c0921101-facb-43a4-addf-1c9791448743] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:26.549594 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ad0b024b-a501-42b7-89f9-5666914ef917 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:26.550048 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ad0b024b-a501-42b7-89f9-5666914ef917 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:26.550834 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ad0b024b-a501-42b7-89f9-5666914ef917 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:26.551271 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ad0b024b-a501-42b7-89f9-5666914ef917 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:26.678635 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-ad0b024b-a501-42b7-89f9-5666914ef917 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fec41eb8ba14082b33f628c86fe48c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874042788a343ec976046e4394fa45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:26.688065 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-ad0b024b-a501-42b7-89f9-5666914ef917 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] 10.222.0.35 "GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743" status: 200 len: 1259 microversion: 2.1 time: 0.149537 Aug 07 04:58:26.688822 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 423/799] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:58:26 2021] GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:58:26.971395 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-f41e60b6-5187-4638-b294-784037d299a0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:26.972171 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-f41e60b6-5187-4638-b294-784037d299a0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:26.978592 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f41e60b6-5187-4638-b294-784037d299a0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:26.979037 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f41e60b6-5187-4638-b294-784037d299a0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:26.979816 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f41e60b6-5187-4638-b294-784037d299a0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:26.980256 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f41e60b6-5187-4638-b294-784037d299a0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:27.108505 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-f41e60b6-5187-4638-b294-784037d299a0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:27.117503 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-f41e60b6-5187-4638-b294-784037d299a0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:27.119668 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-f41e60b6-5187-4638-b294-784037d299a0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:27.120897 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-f41e60b6-5187-4638-b294-784037d299a0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1721 microversion: 2.20 time: 0.153121 Aug 07 04:58:27.121446 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 377/800] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:58:26 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:58:27.138305 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-6fec8736-c88c-43b3-aa59-5cde78a2b4ea tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b5170073-832e-4aa0-af20-6257db8a054e"}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:58:27.139462 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-6fec8736-c88c-43b3-aa59-5cde78a2b4ea tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:27.145249 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6fec8736-c88c-43b3-aa59-5cde78a2b4ea tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:27.145695 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6fec8736-c88c-43b3-aa59-5cde78a2b4ea tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:27.146471 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6fec8736-c88c-43b3-aa59-5cde78a2b4ea tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:27.146903 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6fec8736-c88c-43b3-aa59-5cde78a2b4ea tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:27.449835 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-6fec8736-c88c-43b3-aa59-5cde78a2b4ea tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.315215 Aug 07 04:58:27.450607 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 424/801] 10.222.0.35 () {62 vars in 1364 bytes} [Sat Aug 7 04:58:27 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/os-volume_attachments => generated 188 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 04:58:27.583009 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-83e65990-98e9-4c0b-befc-6102527fdcbd tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:58:27.583568 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-83e65990-98e9-4c0b-befc-6102527fdcbd tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:27.590372 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-83e65990-98e9-4c0b-befc-6102527fdcbd tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:27.590819 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-83e65990-98e9-4c0b-befc-6102527fdcbd tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:27.591579 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-83e65990-98e9-4c0b-befc-6102527fdcbd tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:27.592009 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-83e65990-98e9-4c0b-befc-6102527fdcbd tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:27.670290 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-83e65990-98e9-4c0b-befc-6102527fdcbd tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action" status: 202 len: 0 microversion: 2.20 time: 0.090994 Aug 07 04:58:27.671180 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 378/802] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 04:58:27 2021] POST /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 07 04:58:27.679157 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-e954f03b-733c-405d-a321-3a2b77690e4e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:27.679762 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-e954f03b-733c-405d-a321-3a2b77690e4e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:27.688312 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e954f03b-733c-405d-a321-3a2b77690e4e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:27.688312 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e954f03b-733c-405d-a321-3a2b77690e4e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:27.688312 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e954f03b-733c-405d-a321-3a2b77690e4e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:27.689555 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e954f03b-733c-405d-a321-3a2b77690e4e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:27.705171 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-a0b41649-ba5d-4e0a-9023-f4299db25901 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:27.705960 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-a0b41649-ba5d-4e0a-9023-f4299db25901 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] [instance: c0921101-facb-43a4-addf-1c9791448743] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:27.713334 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a0b41649-ba5d-4e0a-9023-f4299db25901 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:27.714055 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a0b41649-ba5d-4e0a-9023-f4299db25901 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:27.715307 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a0b41649-ba5d-4e0a-9023-f4299db25901 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:27.715959 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a0b41649-ba5d-4e0a-9023-f4299db25901 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:27.830389 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-e954f03b-733c-405d-a321-3a2b77690e4e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:27.839416 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-e954f03b-733c-405d-a321-3a2b77690e4e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:27.842293 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-e954f03b-733c-405d-a321-3a2b77690e4e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:27.843779 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-e954f03b-733c-405d-a321-3a2b77690e4e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1747 microversion: 2.20 time: 0.168450 Aug 07 04:58:27.844505 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 425/803] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:58:27 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1747 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:58:27.860358 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [req-f59610d5-e61a-4126-aa05-e13e263f61f0 req-443405a9-49d2-4395-a71c-242d35d32232 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "431857b6-a453-44f0-829c-00ed610d5fc2", "name": "network-vif-unplugged", "status": "completed", "tag": "6a0264c8-c45c-4fec-b570-31fbf0131107"}]} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:58:27.862233 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 04:58:27.862233 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: warnings.warn(msg) Aug 07 04:58:27.871232 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-f59610d5-e61a-4126-aa05-e13e263f61f0 req-443405a9-49d2-4395-a71c-242d35d32232 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:27.871913 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-f59610d5-e61a-4126-aa05-e13e263f61f0 req-443405a9-49d2-4395-a71c-242d35d32232 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:27.884601 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.compute.server_external_events [req-f59610d5-e61a-4126-aa05-e13e263f61f0 req-443405a9-49d2-4395-a71c-242d35d32232 service nova] Unable to find a host for instance 431857b6-a453-44f0-829c-00ed610d5fc2. Dropping event network-vif-unplugged {{(pid=107486) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Aug 07 04:58:27.886046 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [req-f59610d5-e61a-4126-aa05-e13e263f61f0 req-443405a9-49d2-4395-a71c-242d35d32232 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029110 Aug 07 04:58:27.887189 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 426/804] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 04:58:27 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 07 04:58:27.887658 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-a0b41649-ba5d-4e0a-9023-f4299db25901 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fec41eb8ba14082b33f628c86fe48c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874042788a343ec976046e4394fa45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:27.898164 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-a0b41649-ba5d-4e0a-9023-f4299db25901 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] 10.222.0.35 "GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743" status: 200 len: 1259 microversion: 2.1 time: 0.196668 Aug 07 04:58:27.902045 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 379/805] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:58:27 2021] GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743 => generated 1259 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:58:28.862549 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-e924d846-be33-4f01-a37a-e288b255039a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:28.863187 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-e924d846-be33-4f01-a37a-e288b255039a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:28.869246 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e924d846-be33-4f01-a37a-e288b255039a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:28.869688 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e924d846-be33-4f01-a37a-e288b255039a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:28.870450 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e924d846-be33-4f01-a37a-e288b255039a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:28.870878 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e924d846-be33-4f01-a37a-e288b255039a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:28.917414 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-4e9afb29-1cd9-458a-ad95-392378ca29d7 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:28.919517 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-4e9afb29-1cd9-458a-ad95-392378ca29d7 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] [instance: c0921101-facb-43a4-addf-1c9791448743] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:28.927297 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4e9afb29-1cd9-458a-ad95-392378ca29d7 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:28.927896 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4e9afb29-1cd9-458a-ad95-392378ca29d7 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:28.929053 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4e9afb29-1cd9-458a-ad95-392378ca29d7 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:28.929649 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4e9afb29-1cd9-458a-ad95-392378ca29d7 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:29.015726 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-e924d846-be33-4f01-a37a-e288b255039a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:29.025051 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-e924d846-be33-4f01-a37a-e288b255039a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:29.026817 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-e924d846-be33-4f01-a37a-e288b255039a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:29.027957 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-e924d846-be33-4f01-a37a-e288b255039a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1747 microversion: 2.20 time: 0.169127 Aug 07 04:58:29.028505 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 427/806] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:58:28 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1747 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:58:29.096692 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-4e9afb29-1cd9-458a-ad95-392378ca29d7 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fec41eb8ba14082b33f628c86fe48c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874042788a343ec976046e4394fa45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:29.105413 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-4e9afb29-1cd9-458a-ad95-392378ca29d7 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] 10.222.0.35 "GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743" status: 200 len: 1259 microversion: 2.1 time: 0.191917 Aug 07 04:58:29.105962 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 380/807] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:58:28 2021] GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743 => generated 1259 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:58:30.050430 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-17a7d9cd-4d68-4684-82b9-452a5dc9610c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:30.051731 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-17a7d9cd-4d68-4684-82b9-452a5dc9610c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:30.061671 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-17a7d9cd-4d68-4684-82b9-452a5dc9610c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:30.062129 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-17a7d9cd-4d68-4684-82b9-452a5dc9610c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:30.062920 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-17a7d9cd-4d68-4684-82b9-452a5dc9610c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:30.063423 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-17a7d9cd-4d68-4684-82b9-452a5dc9610c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:30.122793 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-99c669ef-0a90-48fb-ab38-42f6e8bc4fd2 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:30.124117 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-99c669ef-0a90-48fb-ab38-42f6e8bc4fd2 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] [instance: c0921101-facb-43a4-addf-1c9791448743] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:30.130569 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-99c669ef-0a90-48fb-ab38-42f6e8bc4fd2 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:30.131148 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-99c669ef-0a90-48fb-ab38-42f6e8bc4fd2 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:30.132027 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-99c669ef-0a90-48fb-ab38-42f6e8bc4fd2 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:30.132558 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-99c669ef-0a90-48fb-ab38-42f6e8bc4fd2 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:30.196897 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-17a7d9cd-4d68-4684-82b9-452a5dc9610c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:30.214581 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-17a7d9cd-4d68-4684-82b9-452a5dc9610c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:30.216087 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-17a7d9cd-4d68-4684-82b9-452a5dc9610c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:30.217293 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-17a7d9cd-4d68-4684-82b9-452a5dc9610c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1747 microversion: 2.20 time: 0.173955 Aug 07 04:58:30.218364 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 428/808] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:58:30 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1747 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 04:58:30.290415 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-99c669ef-0a90-48fb-ab38-42f6e8bc4fd2 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fec41eb8ba14082b33f628c86fe48c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874042788a343ec976046e4394fa45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:30.303346 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-99c669ef-0a90-48fb-ab38-42f6e8bc4fd2 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] 10.222.0.35 "GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743" status: 200 len: 1259 microversion: 2.1 time: 0.184281 Aug 07 04:58:30.303931 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 381/809] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:58:30 2021] GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743 => generated 1259 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:58:31.236801 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-573d6cf1-7c2f-40f6-b2b1-1f915cab6336 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:31.237593 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-573d6cf1-7c2f-40f6-b2b1-1f915cab6336 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:31.244812 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-573d6cf1-7c2f-40f6-b2b1-1f915cab6336 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:31.245389 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-573d6cf1-7c2f-40f6-b2b1-1f915cab6336 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:31.246299 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-573d6cf1-7c2f-40f6-b2b1-1f915cab6336 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:31.246733 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-573d6cf1-7c2f-40f6-b2b1-1f915cab6336 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:31.319419 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-40249c1e-7812-40d1-b3bb-79efd9741736 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:31.320103 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-40249c1e-7812-40d1-b3bb-79efd9741736 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] [instance: c0921101-facb-43a4-addf-1c9791448743] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:31.328563 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-40249c1e-7812-40d1-b3bb-79efd9741736 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:31.328563 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-40249c1e-7812-40d1-b3bb-79efd9741736 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:31.334706 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-40249c1e-7812-40d1-b3bb-79efd9741736 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:31.335170 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-40249c1e-7812-40d1-b3bb-79efd9741736 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:31.378503 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-573d6cf1-7c2f-40f6-b2b1-1f915cab6336 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:31.387672 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-573d6cf1-7c2f-40f6-b2b1-1f915cab6336 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:31.389285 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-573d6cf1-7c2f-40f6-b2b1-1f915cab6336 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:31.390472 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-573d6cf1-7c2f-40f6-b2b1-1f915cab6336 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1747 microversion: 2.20 time: 0.158659 Aug 07 04:58:31.391025 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 429/810] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:58:31 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1747 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:58:31.469331 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-40249c1e-7812-40d1-b3bb-79efd9741736 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fec41eb8ba14082b33f628c86fe48c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874042788a343ec976046e4394fa45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:31.476589 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-40249c1e-7812-40d1-b3bb-79efd9741736 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] 10.222.0.35 "GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743" status: 200 len: 1259 microversion: 2.1 time: 0.160836 Aug 07 04:58:31.477778 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 382/811] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:58:31 2021] GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 04:58:31.838013 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [req-3976de9f-bbda-48de-907b-fd454ea6d824 req-41345b10-f6cb-419a-9bad-132732e1450b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0921101-facb-43a4-addf-1c9791448743", "name": "network-vif-plugged", "status": "completed", "tag": "018d5d66-f848-4b34-9a5e-9f813a6e1b80"}]} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:58:31.840092 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 04:58:31.840092 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: warnings.warn(msg) Aug 07 04:58:31.846973 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-3976de9f-bbda-48de-907b-fd454ea6d824 req-41345b10-f6cb-419a-9bad-132732e1450b service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:31.847490 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-3976de9f-bbda-48de-907b-fd454ea6d824 req-41345b10-f6cb-419a-9bad-132732e1450b service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:31.861195 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.compute.server_external_events [req-3976de9f-bbda-48de-907b-fd454ea6d824 req-41345b10-f6cb-419a-9bad-132732e1450b service nova] Creating event network-vif-plugged:018d5d66-f848-4b34-9a5e-9f813a6e1b80 for instance c0921101-facb-43a4-addf-1c9791448743 on hv-cinder-80374 Aug 07 04:58:31.866895 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [req-3976de9f-bbda-48de-907b-fd454ea6d824 req-41345b10-f6cb-419a-9bad-132732e1450b service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033609 Aug 07 04:58:31.868568 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 430/812] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 04:58:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:58:32.408988 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-8dea21ae-55fb-4caf-be3a-afcabb784655 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:32.409592 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-8dea21ae-55fb-4caf-be3a-afcabb784655 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:32.415491 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8dea21ae-55fb-4caf-be3a-afcabb784655 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:32.415926 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8dea21ae-55fb-4caf-be3a-afcabb784655 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:32.416688 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8dea21ae-55fb-4caf-be3a-afcabb784655 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:32.417144 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8dea21ae-55fb-4caf-be3a-afcabb784655 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:32.496913 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-17b91f60-c04e-485c-b90c-6f735149ccaa tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:32.497682 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-17b91f60-c04e-485c-b90c-6f735149ccaa tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] [instance: c0921101-facb-43a4-addf-1c9791448743] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:32.503802 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-17b91f60-c04e-485c-b90c-6f735149ccaa tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:32.504246 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-17b91f60-c04e-485c-b90c-6f735149ccaa tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:32.505073 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-17b91f60-c04e-485c-b90c-6f735149ccaa tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:32.505647 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-17b91f60-c04e-485c-b90c-6f735149ccaa tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:32.565571 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-8dea21ae-55fb-4caf-be3a-afcabb784655 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:32.574957 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-8dea21ae-55fb-4caf-be3a-afcabb784655 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:32.576939 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-8dea21ae-55fb-4caf-be3a-afcabb784655 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:32.578066 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-8dea21ae-55fb-4caf-be3a-afcabb784655 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1747 microversion: 2.20 time: 0.172881 Aug 07 04:58:32.578801 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 383/813] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:58:32 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1747 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 04:58:32.643033 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-17b91f60-c04e-485c-b90c-6f735149ccaa tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fec41eb8ba14082b33f628c86fe48c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874042788a343ec976046e4394fa45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:32.652064 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-17b91f60-c04e-485c-b90c-6f735149ccaa tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] 10.222.0.35 "GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743" status: 200 len: 1259 microversion: 2.1 time: 0.160230 Aug 07 04:58:32.652630 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 431/814] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:58:32 2021] GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:58:33.596262 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-97819eca-970c-40aa-9ac5-69c284e8b1e9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:33.597003 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-97819eca-970c-40aa-9ac5-69c284e8b1e9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:33.603325 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-97819eca-970c-40aa-9ac5-69c284e8b1e9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:33.603762 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-97819eca-970c-40aa-9ac5-69c284e8b1e9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:33.604525 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-97819eca-970c-40aa-9ac5-69c284e8b1e9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:33.604978 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-97819eca-970c-40aa-9ac5-69c284e8b1e9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:33.669212 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-47117e6f-c37e-402d-aa81-ddf0f7327647 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:33.670128 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-47117e6f-c37e-402d-aa81-ddf0f7327647 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] [instance: c0921101-facb-43a4-addf-1c9791448743] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:33.676503 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-47117e6f-c37e-402d-aa81-ddf0f7327647 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:33.677123 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-47117e6f-c37e-402d-aa81-ddf0f7327647 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:33.677995 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-47117e6f-c37e-402d-aa81-ddf0f7327647 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:33.678624 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-47117e6f-c37e-402d-aa81-ddf0f7327647 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:33.740051 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-97819eca-970c-40aa-9ac5-69c284e8b1e9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:33.750011 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-97819eca-970c-40aa-9ac5-69c284e8b1e9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:33.754456 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-97819eca-970c-40aa-9ac5-69c284e8b1e9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:33.755623 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-97819eca-970c-40aa-9ac5-69c284e8b1e9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1747 microversion: 2.20 time: 0.163073 Aug 07 04:58:33.756174 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 384/815] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:58:33 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1747 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:58:33.824291 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-47117e6f-c37e-402d-aa81-ddf0f7327647 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fec41eb8ba14082b33f628c86fe48c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874042788a343ec976046e4394fa45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:33.831936 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-47117e6f-c37e-402d-aa81-ddf0f7327647 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] 10.222.0.35 "GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743" status: 200 len: 1259 microversion: 2.1 time: 0.167334 Aug 07 04:58:33.832887 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 432/816] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:58:33 2021] GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743 => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:58:34.773908 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-b9f2e327-b615-4d95-b54a-8fe72050da19 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:34.774514 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-b9f2e327-b615-4d95-b54a-8fe72050da19 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:34.781067 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b9f2e327-b615-4d95-b54a-8fe72050da19 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:34.781517 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b9f2e327-b615-4d95-b54a-8fe72050da19 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:34.782299 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b9f2e327-b615-4d95-b54a-8fe72050da19 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:34.782726 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b9f2e327-b615-4d95-b54a-8fe72050da19 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:34.849922 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-356f3593-a9cc-4e5d-bfb1-5a14c33171fb tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:34.850361 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-356f3593-a9cc-4e5d-bfb1-5a14c33171fb tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] [instance: c0921101-facb-43a4-addf-1c9791448743] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:34.857175 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-356f3593-a9cc-4e5d-bfb1-5a14c33171fb tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:34.857625 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-356f3593-a9cc-4e5d-bfb1-5a14c33171fb tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:34.858421 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-356f3593-a9cc-4e5d-bfb1-5a14c33171fb tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:34.858849 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-356f3593-a9cc-4e5d-bfb1-5a14c33171fb tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:34.912546 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-b9f2e327-b615-4d95-b54a-8fe72050da19 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:34.922282 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-b9f2e327-b615-4d95-b54a-8fe72050da19 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:34.923887 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-b9f2e327-b615-4d95-b54a-8fe72050da19 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:34.925142 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-b9f2e327-b615-4d95-b54a-8fe72050da19 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1747 microversion: 2.20 time: 0.154913 Aug 07 04:58:34.925882 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 385/817] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:58:34 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1747 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:58:34.998906 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-356f3593-a9cc-4e5d-bfb1-5a14c33171fb tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fec41eb8ba14082b33f628c86fe48c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874042788a343ec976046e4394fa45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:35.007182 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-356f3593-a9cc-4e5d-bfb1-5a14c33171fb tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] 10.222.0.35 "GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743" status: 200 len: 1443 microversion: 2.1 time: 0.161616 Aug 07 04:58:35.007775 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 433/818] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:58:34 2021] GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743 => generated 1443 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:58:35.025292 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-6fbf59d5-7cca-4835-befe-c79180a9aa3d tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:35.030802 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-6fbf59d5-7cca-4835-befe-c79180a9aa3d tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] [instance: c0921101-facb-43a4-addf-1c9791448743] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:35.031770 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6fbf59d5-7cca-4835-befe-c79180a9aa3d tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:35.032220 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6fbf59d5-7cca-4835-befe-c79180a9aa3d tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:35.033019 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6fbf59d5-7cca-4835-befe-c79180a9aa3d tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:35.033452 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6fbf59d5-7cca-4835-befe-c79180a9aa3d tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:35.163049 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-6fbf59d5-7cca-4835-befe-c79180a9aa3d tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fec41eb8ba14082b33f628c86fe48c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874042788a343ec976046e4394fa45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:35.170773 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-6fbf59d5-7cca-4835-befe-c79180a9aa3d tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] 10.222.0.35 "GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743" status: 200 len: 1443 microversion: 2.1 time: 0.149944 Aug 07 04:58:35.171337 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 386/819] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:58:35 2021] GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743 => generated 1443 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:58:35.944596 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-117125c9-2732-4c6a-b448-1831c714c5d5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:35.945414 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-117125c9-2732-4c6a-b448-1831c714c5d5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:35.953291 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-117125c9-2732-4c6a-b448-1831c714c5d5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:35.954543 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-117125c9-2732-4c6a-b448-1831c714c5d5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:35.955431 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-117125c9-2732-4c6a-b448-1831c714c5d5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:35.956055 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-117125c9-2732-4c6a-b448-1831c714c5d5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:36.128177 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-117125c9-2732-4c6a-b448-1831c714c5d5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:36.136992 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-117125c9-2732-4c6a-b448-1831c714c5d5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:36.138479 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-117125c9-2732-4c6a-b448-1831c714c5d5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:36.140030 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-117125c9-2732-4c6a-b448-1831c714c5d5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1747 microversion: 2.20 time: 0.199276 Aug 07 04:58:36.140774 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 434/820] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:58:35 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1747 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:58:37.158565 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-98daa5c8-c475-402d-8a2b-3f5e7bfc59a6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:37.159196 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-98daa5c8-c475-402d-8a2b-3f5e7bfc59a6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:37.167259 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-98daa5c8-c475-402d-8a2b-3f5e7bfc59a6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:37.168473 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-98daa5c8-c475-402d-8a2b-3f5e7bfc59a6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:37.169340 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-98daa5c8-c475-402d-8a2b-3f5e7bfc59a6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:37.169772 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-98daa5c8-c475-402d-8a2b-3f5e7bfc59a6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:37.347705 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [req-df5463e5-0fbd-4cf9-9cec-e2db0a2e69bd req-3d7c7d20-53e7-4476-bac6-3219d178a2a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0921101-facb-43a4-addf-1c9791448743", "tag": "018d5d66-f848-4b34-9a5e-9f813a6e1b80"}]} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:58:37.348333 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-98daa5c8-c475-402d-8a2b-3f5e7bfc59a6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:37.354127 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 04:58:37.354127 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: warnings.warn(msg) Aug 07 04:58:37.357952 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-98daa5c8-c475-402d-8a2b-3f5e7bfc59a6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:37.359414 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-98daa5c8-c475-402d-8a2b-3f5e7bfc59a6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:37.360856 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-98daa5c8-c475-402d-8a2b-3f5e7bfc59a6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1749 microversion: 2.20 time: 0.206135 Aug 07 04:58:37.365409 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-df5463e5-0fbd-4cf9-9cec-e2db0a2e69bd req-3d7c7d20-53e7-4476-bac6-3219d178a2a1 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:37.365946 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-df5463e5-0fbd-4cf9-9cec-e2db0a2e69bd req-3d7c7d20-53e7-4476-bac6-3219d178a2a1 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:37.372988 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 387/821] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:58:37 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1749 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:58:37.377894 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.compute.server_external_events [req-df5463e5-0fbd-4cf9-9cec-e2db0a2e69bd req-3d7c7d20-53e7-4476-bac6-3219d178a2a1 service nova] Creating event network-changed:018d5d66-f848-4b34-9a5e-9f813a6e1b80 for instance c0921101-facb-43a4-addf-1c9791448743 on hv-cinder-80374 Aug 07 04:58:37.383817 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [req-df5463e5-0fbd-4cf9-9cec-e2db0a2e69bd req-3d7c7d20-53e7-4476-bac6-3219d178a2a1 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039247 Aug 07 04:58:37.384414 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 435/822] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 04:58:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 04:58:38.379450 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-2fa2fc1c-2bfe-4603-8f9a-b668c80623d9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:38.380054 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-2fa2fc1c-2bfe-4603-8f9a-b668c80623d9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:38.386779 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2fa2fc1c-2bfe-4603-8f9a-b668c80623d9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:38.387220 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2fa2fc1c-2bfe-4603-8f9a-b668c80623d9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:38.387984 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2fa2fc1c-2bfe-4603-8f9a-b668c80623d9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:38.388587 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2fa2fc1c-2bfe-4603-8f9a-b668c80623d9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:38.562788 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-2fa2fc1c-2bfe-4603-8f9a-b668c80623d9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:38.575654 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-2fa2fc1c-2bfe-4603-8f9a-b668c80623d9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:38.578204 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-2fa2fc1c-2bfe-4603-8f9a-b668c80623d9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:38.579601 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-2fa2fc1c-2bfe-4603-8f9a-b668c80623d9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1749 microversion: 2.20 time: 0.204014 Aug 07 04:58:38.580355 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 388/823] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:58:38 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1749 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:58:39.602961 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-265be945-d20a-4de7-b9f0-c48eee9d9657 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:39.604739 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-265be945-d20a-4de7-b9f0-c48eee9d9657 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:39.611734 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-265be945-d20a-4de7-b9f0-c48eee9d9657 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:39.612179 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-265be945-d20a-4de7-b9f0-c48eee9d9657 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:39.613545 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-265be945-d20a-4de7-b9f0-c48eee9d9657 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:39.613545 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-265be945-d20a-4de7-b9f0-c48eee9d9657 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:39.807451 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-265be945-d20a-4de7-b9f0-c48eee9d9657 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:39.815705 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-265be945-d20a-4de7-b9f0-c48eee9d9657 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:39.817217 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-265be945-d20a-4de7-b9f0-c48eee9d9657 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:39.818351 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-265be945-d20a-4de7-b9f0-c48eee9d9657 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1805 microversion: 2.20 time: 0.220163 Aug 07 04:58:39.818892 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 436/824] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:58:39 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1805 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:58:40.841754 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-865745e4-a5c1-4b23-b4c3-f36ff892680b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:40.843054 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-865745e4-a5c1-4b23-b4c3-f36ff892680b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:40.849167 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-865745e4-a5c1-4b23-b4c3-f36ff892680b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:40.849959 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-865745e4-a5c1-4b23-b4c3-f36ff892680b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:40.851069 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-865745e4-a5c1-4b23-b4c3-f36ff892680b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:40.852340 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-865745e4-a5c1-4b23-b4c3-f36ff892680b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:41.254349 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-865745e4-a5c1-4b23-b4c3-f36ff892680b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:41.264426 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-865745e4-a5c1-4b23-b4c3-f36ff892680b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:41.266102 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-865745e4-a5c1-4b23-b4c3-f36ff892680b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:41.267401 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-865745e4-a5c1-4b23-b4c3-f36ff892680b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1805 microversion: 2.20 time: 0.430276 Aug 07 04:58:41.273382 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 389/825] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:58:40 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1805 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:58:42.292388 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-57b4c148-23ee-4cd5-b0f7-032f8ee2b95e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:42.293024 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-57b4c148-23ee-4cd5-b0f7-032f8ee2b95e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:42.299048 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-57b4c148-23ee-4cd5-b0f7-032f8ee2b95e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:42.299521 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-57b4c148-23ee-4cd5-b0f7-032f8ee2b95e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:42.300287 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-57b4c148-23ee-4cd5-b0f7-032f8ee2b95e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:42.300717 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-57b4c148-23ee-4cd5-b0f7-032f8ee2b95e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:42.443599 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-57b4c148-23ee-4cd5-b0f7-032f8ee2b95e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:42.452856 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-57b4c148-23ee-4cd5-b0f7-032f8ee2b95e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:42.454686 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-57b4c148-23ee-4cd5-b0f7-032f8ee2b95e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:42.456091 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-57b4c148-23ee-4cd5-b0f7-032f8ee2b95e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1805 microversion: 2.20 time: 0.168863 Aug 07 04:58:42.457385 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 437/826] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:58:42 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1805 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:58:43.475100 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-4e8660d6-044b-4c44-b6cd-70114307df96 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:43.475714 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-4e8660d6-044b-4c44-b6cd-70114307df96 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:43.483537 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4e8660d6-044b-4c44-b6cd-70114307df96 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:43.483988 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4e8660d6-044b-4c44-b6cd-70114307df96 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:43.484993 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4e8660d6-044b-4c44-b6cd-70114307df96 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:43.485496 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4e8660d6-044b-4c44-b6cd-70114307df96 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:43.645050 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-4e8660d6-044b-4c44-b6cd-70114307df96 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:43.655114 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-4e8660d6-044b-4c44-b6cd-70114307df96 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:43.663507 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-4e8660d6-044b-4c44-b6cd-70114307df96 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:43.665661 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-4e8660d6-044b-4c44-b6cd-70114307df96 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1805 microversion: 2.20 time: 0.194270 Aug 07 04:58:43.669159 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 390/827] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:58:43 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1805 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:58:44.684318 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-3807eee6-dbfc-4c10-96ec-eb96f93d3e1a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:44.685005 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-3807eee6-dbfc-4c10-96ec-eb96f93d3e1a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:44.690720 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3807eee6-dbfc-4c10-96ec-eb96f93d3e1a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:44.691168 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3807eee6-dbfc-4c10-96ec-eb96f93d3e1a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:44.691934 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3807eee6-dbfc-4c10-96ec-eb96f93d3e1a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:44.692366 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3807eee6-dbfc-4c10-96ec-eb96f93d3e1a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:44.834501 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-3807eee6-dbfc-4c10-96ec-eb96f93d3e1a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:44.846149 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-3807eee6-dbfc-4c10-96ec-eb96f93d3e1a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:44.847694 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-3807eee6-dbfc-4c10-96ec-eb96f93d3e1a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:44.848859 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-3807eee6-dbfc-4c10-96ec-eb96f93d3e1a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1805 microversion: 2.20 time: 0.169314 Aug 07 04:58:44.849423 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 438/828] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:58:44 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1805 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:58:45.868555 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-d6b7bc57-0fb7-4381-ab9f-f9536cc1b7b4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:45.869979 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-d6b7bc57-0fb7-4381-ab9f-f9536cc1b7b4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:45.877497 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d6b7bc57-0fb7-4381-ab9f-f9536cc1b7b4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:45.878025 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d6b7bc57-0fb7-4381-ab9f-f9536cc1b7b4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:45.878929 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d6b7bc57-0fb7-4381-ab9f-f9536cc1b7b4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:45.879570 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d6b7bc57-0fb7-4381-ab9f-f9536cc1b7b4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:46.043317 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-d6b7bc57-0fb7-4381-ab9f-f9536cc1b7b4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:46.053694 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-d6b7bc57-0fb7-4381-ab9f-f9536cc1b7b4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:46.055993 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-d6b7bc57-0fb7-4381-ab9f-f9536cc1b7b4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:46.057165 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-d6b7bc57-0fb7-4381-ab9f-f9536cc1b7b4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1805 microversion: 2.20 time: 0.193540 Aug 07 04:58:46.057699 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 391/829] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:58:45 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1805 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:58:47.081262 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-97679b76-a635-46ea-9fe2-07e7aac90d77 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:47.081950 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-97679b76-a635-46ea-9fe2-07e7aac90d77 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:47.097680 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-97679b76-a635-46ea-9fe2-07e7aac90d77 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:47.098128 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-97679b76-a635-46ea-9fe2-07e7aac90d77 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:47.098909 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-97679b76-a635-46ea-9fe2-07e7aac90d77 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:47.099721 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-97679b76-a635-46ea-9fe2-07e7aac90d77 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:47.261542 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-97679b76-a635-46ea-9fe2-07e7aac90d77 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:47.272394 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-97679b76-a635-46ea-9fe2-07e7aac90d77 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:47.275296 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-97679b76-a635-46ea-9fe2-07e7aac90d77 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:47.276395 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-97679b76-a635-46ea-9fe2-07e7aac90d77 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1805 microversion: 2.20 time: 0.201371 Aug 07 04:58:47.277278 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 439/830] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:58:47 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1805 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:58:48.294956 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-5c17fba3-3c3b-46f6-8828-47b87cbeed8e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:48.295543 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-5c17fba3-3c3b-46f6-8828-47b87cbeed8e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:48.301432 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5c17fba3-3c3b-46f6-8828-47b87cbeed8e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:48.301877 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5c17fba3-3c3b-46f6-8828-47b87cbeed8e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:48.302649 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5c17fba3-3c3b-46f6-8828-47b87cbeed8e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:48.303084 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5c17fba3-3c3b-46f6-8828-47b87cbeed8e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:48.433498 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-5c17fba3-3c3b-46f6-8828-47b87cbeed8e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:48.442032 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-5c17fba3-3c3b-46f6-8828-47b87cbeed8e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:48.443516 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-5c17fba3-3c3b-46f6-8828-47b87cbeed8e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:48.444651 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-5c17fba3-3c3b-46f6-8828-47b87cbeed8e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1805 microversion: 2.20 time: 0.153496 Aug 07 04:58:48.445239 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 392/831] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:58:48 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1805 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:58:49.180994 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 04:58:49.181249 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: Sat Aug 7 04:58:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 04:58:49.705592 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-6b006161-9d6f-4879-995b-7af4f4468311 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:49.706208 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-6b006161-9d6f-4879-995b-7af4f4468311 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:49.713353 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6b006161-9d6f-4879-995b-7af4f4468311 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:49.713801 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6b006161-9d6f-4879-995b-7af4f4468311 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:49.714575 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6b006161-9d6f-4879-995b-7af4f4468311 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:49.715016 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6b006161-9d6f-4879-995b-7af4f4468311 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:49.839780 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-6b006161-9d6f-4879-995b-7af4f4468311 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:49.848354 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-6b006161-9d6f-4879-995b-7af4f4468311 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:49.849856 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-6b006161-9d6f-4879-995b-7af4f4468311 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:49.851022 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-6b006161-9d6f-4879-995b-7af4f4468311 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1805 microversion: 2.20 time: 0.392201 Aug 07 04:58:49.852854 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 440/832] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:58:49 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1805 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:58:50.871541 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-97d05e66-679b-4199-abf6-ef40ce581a04 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:50.872328 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-97d05e66-679b-4199-abf6-ef40ce581a04 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:50.878493 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-97d05e66-679b-4199-abf6-ef40ce581a04 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:50.878943 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-97d05e66-679b-4199-abf6-ef40ce581a04 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:50.879720 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-97d05e66-679b-4199-abf6-ef40ce581a04 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:50.880149 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-97d05e66-679b-4199-abf6-ef40ce581a04 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:51.000293 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-97d05e66-679b-4199-abf6-ef40ce581a04 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:51.009749 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-97d05e66-679b-4199-abf6-ef40ce581a04 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:51.011622 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-97d05e66-679b-4199-abf6-ef40ce581a04 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:51.012964 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-97d05e66-679b-4199-abf6-ef40ce581a04 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1805 microversion: 2.20 time: 0.146922 Aug 07 04:58:51.014445 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 393/833] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:58:50 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1805 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:58:52.031169 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-b5bdec12-5e7b-4d6c-b2c3-278da4c80c65 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:52.032480 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-b5bdec12-5e7b-4d6c-b2c3-278da4c80c65 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:52.038416 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b5bdec12-5e7b-4d6c-b2c3-278da4c80c65 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:52.039455 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b5bdec12-5e7b-4d6c-b2c3-278da4c80c65 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:52.041262 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b5bdec12-5e7b-4d6c-b2c3-278da4c80c65 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:52.041961 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b5bdec12-5e7b-4d6c-b2c3-278da4c80c65 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:52.172309 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-b5bdec12-5e7b-4d6c-b2c3-278da4c80c65 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:52.181239 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-b5bdec12-5e7b-4d6c-b2c3-278da4c80c65 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:52.182730 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-b5bdec12-5e7b-4d6c-b2c3-278da4c80c65 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:52.183866 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-b5bdec12-5e7b-4d6c-b2c3-278da4c80c65 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1805 microversion: 2.20 time: 0.156482 Aug 07 04:58:52.184418 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 441/834] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:58:52 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1805 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:58:53.202095 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-18c8304c-25e9-4552-8c03-085689805226 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:53.202713 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-18c8304c-25e9-4552-8c03-085689805226 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:53.208721 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-18c8304c-25e9-4552-8c03-085689805226 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:53.209199 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-18c8304c-25e9-4552-8c03-085689805226 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:53.209966 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-18c8304c-25e9-4552-8c03-085689805226 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:53.210941 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-18c8304c-25e9-4552-8c03-085689805226 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:53.342004 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-18c8304c-25e9-4552-8c03-085689805226 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:53.350622 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-18c8304c-25e9-4552-8c03-085689805226 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:53.352111 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-18c8304c-25e9-4552-8c03-085689805226 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:53.353273 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-18c8304c-25e9-4552-8c03-085689805226 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1805 microversion: 2.20 time: 0.154917 Aug 07 04:58:53.353825 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 394/835] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:58:53 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1805 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:58:54.371693 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-945131f6-7f7d-4e16-a9b8-32f850a58830 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:54.372352 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-945131f6-7f7d-4e16-a9b8-32f850a58830 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:54.379016 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-945131f6-7f7d-4e16-a9b8-32f850a58830 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:54.379461 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-945131f6-7f7d-4e16-a9b8-32f850a58830 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:54.380235 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-945131f6-7f7d-4e16-a9b8-32f850a58830 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:54.380658 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-945131f6-7f7d-4e16-a9b8-32f850a58830 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:54.517834 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-945131f6-7f7d-4e16-a9b8-32f850a58830 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:54.526777 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-945131f6-7f7d-4e16-a9b8-32f850a58830 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:54.528276 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-945131f6-7f7d-4e16-a9b8-32f850a58830 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:54.529476 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-945131f6-7f7d-4e16-a9b8-32f850a58830 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1805 microversion: 2.20 time: 0.162433 Aug 07 04:58:54.530034 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 442/836] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:58:54 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1805 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:58:55.549429 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-c441ee7d-ad69-445e-8aa2-f85b9e41d8ec tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:55.550034 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-c441ee7d-ad69-445e-8aa2-f85b9e41d8ec tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:55.556604 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c441ee7d-ad69-445e-8aa2-f85b9e41d8ec tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:55.557070 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c441ee7d-ad69-445e-8aa2-f85b9e41d8ec tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:55.557834 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c441ee7d-ad69-445e-8aa2-f85b9e41d8ec tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:55.558264 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c441ee7d-ad69-445e-8aa2-f85b9e41d8ec tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:55.686984 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-c441ee7d-ad69-445e-8aa2-f85b9e41d8ec tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:55.695830 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-c441ee7d-ad69-445e-8aa2-f85b9e41d8ec tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:55.697345 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-c441ee7d-ad69-445e-8aa2-f85b9e41d8ec tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:55.698479 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-c441ee7d-ad69-445e-8aa2-f85b9e41d8ec tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1805 microversion: 2.20 time: 0.153807 Aug 07 04:58:55.699033 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 395/837] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:58:55 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1805 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:58:56.514930 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-4ae97ff6-f740-4d40-aede-aa535dbc89a7 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1d24853e-12b0-4600-8711-7e4236bdf1e5", "device": "/dev/sdb"}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:58:56.516522 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-4ae97ff6-f740-4d40-aede-aa535dbc89a7 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] [instance: 28314017-c8b0-4a57-8ffb-7fa1aee0232e] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:56.522354 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4ae97ff6-f740-4d40-aede-aa535dbc89a7 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:56.523230 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4ae97ff6-f740-4d40-aede-aa535dbc89a7 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:56.524018 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4ae97ff6-f740-4d40-aede-aa535dbc89a7 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:56.524454 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4ae97ff6-f740-4d40-aede-aa535dbc89a7 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:56.717218 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-3d23762e-a3b0-450c-b7fe-a6bfbb39faa8 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:56.717824 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-3d23762e-a3b0-450c-b7fe-a6bfbb39faa8 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:56.723654 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3d23762e-a3b0-450c-b7fe-a6bfbb39faa8 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:56.724097 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3d23762e-a3b0-450c-b7fe-a6bfbb39faa8 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:56.724877 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3d23762e-a3b0-450c-b7fe-a6bfbb39faa8 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:56.725307 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3d23762e-a3b0-450c-b7fe-a6bfbb39faa8 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:56.842995 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-3d23762e-a3b0-450c-b7fe-a6bfbb39faa8 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:56.851790 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-3d23762e-a3b0-450c-b7fe-a6bfbb39faa8 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:56.853327 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-3d23762e-a3b0-450c-b7fe-a6bfbb39faa8 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:56.854443 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-3d23762e-a3b0-450c-b7fe-a6bfbb39faa8 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1805 microversion: 2.20 time: 0.140900 Aug 07 04:58:56.854986 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 396/838] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:58:56 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1805 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:58:57.872501 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-fe1a2afb-d252-4342-b239-ffcdb217d016 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:57.873180 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-fe1a2afb-d252-4342-b239-ffcdb217d016 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:57.878844 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-fe1a2afb-d252-4342-b239-ffcdb217d016 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:57.879285 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-fe1a2afb-d252-4342-b239-ffcdb217d016 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:57.880039 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-fe1a2afb-d252-4342-b239-ffcdb217d016 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:57.880465 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-fe1a2afb-d252-4342-b239-ffcdb217d016 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:57.997198 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-fe1a2afb-d252-4342-b239-ffcdb217d016 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:58.005273 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-fe1a2afb-d252-4342-b239-ffcdb217d016 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:58.006780 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-fe1a2afb-d252-4342-b239-ffcdb217d016 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:58.008603 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-fe1a2afb-d252-4342-b239-ffcdb217d016 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1805 microversion: 2.20 time: 0.139912 Aug 07 04:58:58.009166 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 397/839] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:58:57 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1805 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 04:58:59.026387 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-8bdcf92c-cb03-458f-aff1-ef31b5b45f67 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:58:59.027040 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-8bdcf92c-cb03-458f-aff1-ef31b5b45f67 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:58:59.032755 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8bdcf92c-cb03-458f-aff1-ef31b5b45f67 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:59.033232 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8bdcf92c-cb03-458f-aff1-ef31b5b45f67 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:59.034001 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8bdcf92c-cb03-458f-aff1-ef31b5b45f67 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:58:59.034434 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8bdcf92c-cb03-458f-aff1-ef31b5b45f67 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:58:59.158476 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-8bdcf92c-cb03-458f-aff1-ef31b5b45f67 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:59.167542 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-8bdcf92c-cb03-458f-aff1-ef31b5b45f67 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:59.169045 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-8bdcf92c-cb03-458f-aff1-ef31b5b45f67 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:58:59.170160 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-8bdcf92c-cb03-458f-aff1-ef31b5b45f67 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1805 microversion: 2.20 time: 0.148181 Aug 07 04:58:59.170724 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 398/840] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:58:59 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1805 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 04:59:00.188022 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-dac8f6f7-6013-47d8-ab0f-cb0bfb4e3da3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:59:00.188701 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-dac8f6f7-6013-47d8-ab0f-cb0bfb4e3da3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:59:00.195111 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-dac8f6f7-6013-47d8-ab0f-cb0bfb4e3da3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:00.195549 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-dac8f6f7-6013-47d8-ab0f-cb0bfb4e3da3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:00.196305 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-dac8f6f7-6013-47d8-ab0f-cb0bfb4e3da3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:00.196733 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-dac8f6f7-6013-47d8-ab0f-cb0bfb4e3da3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:00.314737 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-dac8f6f7-6013-47d8-ab0f-cb0bfb4e3da3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:00.323348 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-dac8f6f7-6013-47d8-ab0f-cb0bfb4e3da3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:00.324831 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-dac8f6f7-6013-47d8-ab0f-cb0bfb4e3da3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:00.325950 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-dac8f6f7-6013-47d8-ab0f-cb0bfb4e3da3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1805 microversion: 2.20 time: 0.141631 Aug 07 04:59:00.326495 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 399/841] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:59:00 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1805 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 04:59:01.345540 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-ae483633-c8b2-417f-a772-5e7b46b838e3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:59:01.346211 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-ae483633-c8b2-417f-a772-5e7b46b838e3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:59:01.352115 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ae483633-c8b2-417f-a772-5e7b46b838e3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:01.352553 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ae483633-c8b2-417f-a772-5e7b46b838e3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:01.353328 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ae483633-c8b2-417f-a772-5e7b46b838e3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:01.353754 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ae483633-c8b2-417f-a772-5e7b46b838e3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:01.481060 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-ae483633-c8b2-417f-a772-5e7b46b838e3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:01.489226 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-ae483633-c8b2-417f-a772-5e7b46b838e3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:01.490771 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-ae483633-c8b2-417f-a772-5e7b46b838e3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:01.492731 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-ae483633-c8b2-417f-a772-5e7b46b838e3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1805 microversion: 2.20 time: 0.150762 Aug 07 04:59:01.493331 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 400/842] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:59:01 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1805 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 04:59:02.510059 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-4a4d7266-d811-42ad-b98a-4f9473585e75 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:59:02.510762 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-4a4d7266-d811-42ad-b98a-4f9473585e75 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:59:02.516582 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4a4d7266-d811-42ad-b98a-4f9473585e75 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:02.517061 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4a4d7266-d811-42ad-b98a-4f9473585e75 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:02.517827 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4a4d7266-d811-42ad-b98a-4f9473585e75 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:02.518261 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4a4d7266-d811-42ad-b98a-4f9473585e75 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:02.642495 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-4a4d7266-d811-42ad-b98a-4f9473585e75 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:02.651285 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-4a4d7266-d811-42ad-b98a-4f9473585e75 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:02.652761 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-4a4d7266-d811-42ad-b98a-4f9473585e75 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:02.653919 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-4a4d7266-d811-42ad-b98a-4f9473585e75 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1805 microversion: 2.20 time: 0.147738 Aug 07 04:59:02.654469 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 401/843] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:59:02 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1805 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 04:59:03.632909 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-4ae97ff6-f740-4d40-aede-aa535dbc89a7 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] 10.222.0.35 "POST /compute/v2.1/servers/28314017-c8b0-4a57-8ffb-7fa1aee0232e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.118568 Aug 07 04:59:03.632909 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 443/844] 10.222.0.35 () {60 vars in 1323 bytes} [Sat Aug 7 04:58:56 2021] POST /compute/v2.1/servers/28314017-c8b0-4a57-8ffb-7fa1aee0232e/os-volume_attachments => generated 194 bytes in 7120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:59:03.672201 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-2f4752e3-58b9-40fd-8e41-c4b391811523 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:59:03.672838 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-2f4752e3-58b9-40fd-8e41-c4b391811523 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:59:03.679226 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2f4752e3-58b9-40fd-8e41-c4b391811523 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:03.679746 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2f4752e3-58b9-40fd-8e41-c4b391811523 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:03.680514 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2f4752e3-58b9-40fd-8e41-c4b391811523 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:03.681138 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2f4752e3-58b9-40fd-8e41-c4b391811523 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:03.905546 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-2f4752e3-58b9-40fd-8e41-c4b391811523 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:03.913876 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-2f4752e3-58b9-40fd-8e41-c4b391811523 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:03.915354 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-2f4752e3-58b9-40fd-8e41-c4b391811523 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:03.916482 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-2f4752e3-58b9-40fd-8e41-c4b391811523 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1805 microversion: 2.20 time: 0.248011 Aug 07 04:59:03.917060 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 402/845] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:59:03 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1805 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:59:04.936063 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-242b66f2-9420-4910-b893-af00737c48df tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:59:04.936756 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-242b66f2-9420-4910-b893-af00737c48df tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:59:04.942971 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-242b66f2-9420-4910-b893-af00737c48df tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:04.943410 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-242b66f2-9420-4910-b893-af00737c48df tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:04.944170 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-242b66f2-9420-4910-b893-af00737c48df tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:04.944598 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-242b66f2-9420-4910-b893-af00737c48df tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:05.066025 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-242b66f2-9420-4910-b893-af00737c48df tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:05.074876 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-242b66f2-9420-4910-b893-af00737c48df tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:05.076366 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-242b66f2-9420-4910-b893-af00737c48df tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:05.077529 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-242b66f2-9420-4910-b893-af00737c48df tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1805 microversion: 2.20 time: 0.146073 Aug 07 04:59:05.078087 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 444/846] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:59:04 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1805 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:59:06.096576 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-6781a3d1-903c-42fc-8116-1dfe46a04ea3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:59:06.097212 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-6781a3d1-903c-42fc-8116-1dfe46a04ea3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:59:06.103079 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6781a3d1-903c-42fc-8116-1dfe46a04ea3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:06.103521 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6781a3d1-903c-42fc-8116-1dfe46a04ea3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:06.104283 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6781a3d1-903c-42fc-8116-1dfe46a04ea3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:06.104717 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6781a3d1-903c-42fc-8116-1dfe46a04ea3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:06.224669 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-6781a3d1-903c-42fc-8116-1dfe46a04ea3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:06.233035 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-6781a3d1-903c-42fc-8116-1dfe46a04ea3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:06.234520 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-6781a3d1-903c-42fc-8116-1dfe46a04ea3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:06.235648 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-6781a3d1-903c-42fc-8116-1dfe46a04ea3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1805 microversion: 2.20 time: 0.142774 Aug 07 04:59:06.236195 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 403/847] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:59:06 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1805 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:59:07.253894 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-00aca30e-97a9-47bb-ae72-176e9ef68b1f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:59:07.254495 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-00aca30e-97a9-47bb-ae72-176e9ef68b1f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:59:07.261421 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-00aca30e-97a9-47bb-ae72-176e9ef68b1f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:07.261860 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-00aca30e-97a9-47bb-ae72-176e9ef68b1f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:07.262616 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-00aca30e-97a9-47bb-ae72-176e9ef68b1f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:07.263044 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-00aca30e-97a9-47bb-ae72-176e9ef68b1f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:07.383416 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-00aca30e-97a9-47bb-ae72-176e9ef68b1f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:07.391578 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-00aca30e-97a9-47bb-ae72-176e9ef68b1f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:07.393069 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-00aca30e-97a9-47bb-ae72-176e9ef68b1f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:07.394190 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-00aca30e-97a9-47bb-ae72-176e9ef68b1f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1805 microversion: 2.20 time: 0.144051 Aug 07 04:59:07.394736 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 445/848] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:59:07 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1805 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:59:08.412442 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-36519c73-f543-464a-8d48-c90f2f80337f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:59:08.413134 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-36519c73-f543-464a-8d48-c90f2f80337f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:59:08.419329 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-36519c73-f543-464a-8d48-c90f2f80337f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:08.419745 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-36519c73-f543-464a-8d48-c90f2f80337f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:08.420507 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-36519c73-f543-464a-8d48-c90f2f80337f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:08.420963 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-36519c73-f543-464a-8d48-c90f2f80337f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:08.545061 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-36519c73-f543-464a-8d48-c90f2f80337f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:08.553216 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-36519c73-f543-464a-8d48-c90f2f80337f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:08.555092 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-36519c73-f543-464a-8d48-c90f2f80337f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:08.556216 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-36519c73-f543-464a-8d48-c90f2f80337f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1805 microversion: 2.20 time: 0.147452 Aug 07 04:59:08.556765 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 404/849] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:59:08 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1805 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:59:09.574291 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-70c614e4-615a-4e9e-8070-d997b935edcf tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:59:09.574928 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-70c614e4-615a-4e9e-8070-d997b935edcf tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:59:09.580795 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-70c614e4-615a-4e9e-8070-d997b935edcf tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:09.581258 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-70c614e4-615a-4e9e-8070-d997b935edcf tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:09.582046 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-70c614e4-615a-4e9e-8070-d997b935edcf tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:09.582481 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-70c614e4-615a-4e9e-8070-d997b935edcf tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:09.699768 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-70c614e4-615a-4e9e-8070-d997b935edcf tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:09.707951 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-70c614e4-615a-4e9e-8070-d997b935edcf tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:09.709472 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-70c614e4-615a-4e9e-8070-d997b935edcf tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:09.710604 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-70c614e4-615a-4e9e-8070-d997b935edcf tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1805 microversion: 2.20 time: 0.140069 Aug 07 04:59:09.711161 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 446/850] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:59:09 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1805 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:59:10.728877 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-b0880289-5b7b-44f2-8523-2935cce281ce tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:59:10.729516 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-b0880289-5b7b-44f2-8523-2935cce281ce tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:59:10.735399 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b0880289-5b7b-44f2-8523-2935cce281ce tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:10.735840 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b0880289-5b7b-44f2-8523-2935cce281ce tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:10.736600 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b0880289-5b7b-44f2-8523-2935cce281ce tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:10.737069 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b0880289-5b7b-44f2-8523-2935cce281ce tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:10.854545 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-b0880289-5b7b-44f2-8523-2935cce281ce tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:10.862695 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-b0880289-5b7b-44f2-8523-2935cce281ce tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:10.864179 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-b0880289-5b7b-44f2-8523-2935cce281ce tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:10.865357 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-b0880289-5b7b-44f2-8523-2935cce281ce tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1805 microversion: 2.20 time: 0.140239 Aug 07 04:59:10.865922 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 405/851] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:59:10 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1805 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:59:11.882894 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-c0c0ca20-c689-4836-8628-eae0031517f5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:59:11.883696 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-c0c0ca20-c689-4836-8628-eae0031517f5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:59:11.891131 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c0c0ca20-c689-4836-8628-eae0031517f5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:11.891923 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c0c0ca20-c689-4836-8628-eae0031517f5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:11.892685 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c0c0ca20-c689-4836-8628-eae0031517f5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:11.893155 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c0c0ca20-c689-4836-8628-eae0031517f5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:12.015569 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-c0c0ca20-c689-4836-8628-eae0031517f5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:12.024981 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-c0c0ca20-c689-4836-8628-eae0031517f5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:12.026725 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-c0c0ca20-c689-4836-8628-eae0031517f5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:12.028072 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-c0c0ca20-c689-4836-8628-eae0031517f5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1805 microversion: 2.20 time: 0.148834 Aug 07 04:59:12.029242 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 447/852] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:59:11 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1805 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:59:13.046973 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-f1e5486f-de65-4ada-9db2-1c7c49216b4e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:59:13.047521 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-f1e5486f-de65-4ada-9db2-1c7c49216b4e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:59:13.053332 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f1e5486f-de65-4ada-9db2-1c7c49216b4e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:13.053774 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f1e5486f-de65-4ada-9db2-1c7c49216b4e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:13.054533 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f1e5486f-de65-4ada-9db2-1c7c49216b4e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:13.054970 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f1e5486f-de65-4ada-9db2-1c7c49216b4e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:13.178986 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-f1e5486f-de65-4ada-9db2-1c7c49216b4e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:13.187694 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-f1e5486f-de65-4ada-9db2-1c7c49216b4e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:13.189196 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-f1e5486f-de65-4ada-9db2-1c7c49216b4e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:13.190343 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-f1e5486f-de65-4ada-9db2-1c7c49216b4e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1805 microversion: 2.20 time: 0.147128 Aug 07 04:59:13.190886 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 406/853] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:59:13 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1805 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:59:14.209120 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-2ed3ec67-1afd-41d8-8128-4baabee76458 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:59:14.209729 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-2ed3ec67-1afd-41d8-8128-4baabee76458 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:59:14.216236 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2ed3ec67-1afd-41d8-8128-4baabee76458 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:14.216681 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2ed3ec67-1afd-41d8-8128-4baabee76458 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:14.217477 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2ed3ec67-1afd-41d8-8128-4baabee76458 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:14.217906 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2ed3ec67-1afd-41d8-8128-4baabee76458 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:14.338218 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-2ed3ec67-1afd-41d8-8128-4baabee76458 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:14.346383 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-2ed3ec67-1afd-41d8-8128-4baabee76458 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:14.347864 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-2ed3ec67-1afd-41d8-8128-4baabee76458 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:14.349019 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-2ed3ec67-1afd-41d8-8128-4baabee76458 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1805 microversion: 2.20 time: 0.143595 Aug 07 04:59:14.349590 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 448/854] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:59:14 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1805 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:59:15.367956 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-a1ffc166-1d9b-4ad8-8a6e-f4fedf359d39 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:59:15.368557 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-a1ffc166-1d9b-4ad8-8a6e-f4fedf359d39 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:59:15.375328 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a1ffc166-1d9b-4ad8-8a6e-f4fedf359d39 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:15.375773 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a1ffc166-1d9b-4ad8-8a6e-f4fedf359d39 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:15.376534 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a1ffc166-1d9b-4ad8-8a6e-f4fedf359d39 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:15.376990 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a1ffc166-1d9b-4ad8-8a6e-f4fedf359d39 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:15.503922 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-a1ffc166-1d9b-4ad8-8a6e-f4fedf359d39 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:15.512871 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-a1ffc166-1d9b-4ad8-8a6e-f4fedf359d39 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:15.514330 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-a1ffc166-1d9b-4ad8-8a6e-f4fedf359d39 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:15.515447 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-a1ffc166-1d9b-4ad8-8a6e-f4fedf359d39 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1805 microversion: 2.20 time: 0.151138 Aug 07 04:59:15.515994 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 407/855] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:59:15 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1805 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:59:16.533486 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-297ed92d-cee4-4669-8225-3567fec1f49e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:59:16.534673 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-297ed92d-cee4-4669-8225-3567fec1f49e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:59:16.541594 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-297ed92d-cee4-4669-8225-3567fec1f49e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:16.542040 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-297ed92d-cee4-4669-8225-3567fec1f49e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:16.542807 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-297ed92d-cee4-4669-8225-3567fec1f49e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:16.543232 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-297ed92d-cee4-4669-8225-3567fec1f49e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:16.663422 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-297ed92d-cee4-4669-8225-3567fec1f49e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:16.671732 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-297ed92d-cee4-4669-8225-3567fec1f49e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:16.673375 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-297ed92d-cee4-4669-8225-3567fec1f49e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:16.674510 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-297ed92d-cee4-4669-8225-3567fec1f49e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1805 microversion: 2.20 time: 0.144746 Aug 07 04:59:16.675097 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 449/856] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:59:16 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1805 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:59:17.692821 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-bda4d376-dd21-42bc-ac10-d9441430de64 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:59:17.693516 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-bda4d376-dd21-42bc-ac10-d9441430de64 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:59:17.699396 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-bda4d376-dd21-42bc-ac10-d9441430de64 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:17.699824 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-bda4d376-dd21-42bc-ac10-d9441430de64 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:17.700576 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-bda4d376-dd21-42bc-ac10-d9441430de64 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:17.701042 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-bda4d376-dd21-42bc-ac10-d9441430de64 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:17.822798 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-bda4d376-dd21-42bc-ac10-d9441430de64 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:17.831030 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-bda4d376-dd21-42bc-ac10-d9441430de64 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:17.832514 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-bda4d376-dd21-42bc-ac10-d9441430de64 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:17.833682 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-bda4d376-dd21-42bc-ac10-d9441430de64 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1805 microversion: 2.20 time: 0.144683 Aug 07 04:59:17.834235 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 408/857] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:59:17 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1805 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:59:18.852430 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-241eaf66-8e94-44ab-ab8b-7576e32d39cc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:59:18.853847 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-241eaf66-8e94-44ab-ab8b-7576e32d39cc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:59:18.859693 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-241eaf66-8e94-44ab-ab8b-7576e32d39cc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:18.860168 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-241eaf66-8e94-44ab-ab8b-7576e32d39cc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:18.860982 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-241eaf66-8e94-44ab-ab8b-7576e32d39cc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:18.861435 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-241eaf66-8e94-44ab-ab8b-7576e32d39cc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:18.982654 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-241eaf66-8e94-44ab-ab8b-7576e32d39cc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:18.990840 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-241eaf66-8e94-44ab-ab8b-7576e32d39cc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:18.992311 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-241eaf66-8e94-44ab-ab8b-7576e32d39cc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:18.993498 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-241eaf66-8e94-44ab-ab8b-7576e32d39cc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1805 microversion: 2.20 time: 0.144778 Aug 07 04:59:18.994605 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 450/858] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:59:18 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1805 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:59:20.011411 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-9b2f021c-cd85-44d5-9147-92f078a7131f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:59:20.012133 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-9b2f021c-cd85-44d5-9147-92f078a7131f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:59:20.017825 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9b2f021c-cd85-44d5-9147-92f078a7131f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:20.018261 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9b2f021c-cd85-44d5-9147-92f078a7131f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:20.019023 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9b2f021c-cd85-44d5-9147-92f078a7131f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:20.019448 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9b2f021c-cd85-44d5-9147-92f078a7131f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:20.137843 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-9b2f021c-cd85-44d5-9147-92f078a7131f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:20.146008 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-9b2f021c-cd85-44d5-9147-92f078a7131f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:20.147499 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-9b2f021c-cd85-44d5-9147-92f078a7131f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:20.148619 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-9b2f021c-cd85-44d5-9147-92f078a7131f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1805 microversion: 2.20 time: 0.141026 Aug 07 04:59:20.149225 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 409/859] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:59:20 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1805 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:59:21.167097 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-cdcd010e-c652-4e30-9048-8d54e27fce1c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:59:21.167660 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-cdcd010e-c652-4e30-9048-8d54e27fce1c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:59:21.174006 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-cdcd010e-c652-4e30-9048-8d54e27fce1c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:21.174439 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-cdcd010e-c652-4e30-9048-8d54e27fce1c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:21.175206 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-cdcd010e-c652-4e30-9048-8d54e27fce1c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:21.175641 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-cdcd010e-c652-4e30-9048-8d54e27fce1c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:21.295764 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-cdcd010e-c652-4e30-9048-8d54e27fce1c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:21.308607 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-cdcd010e-c652-4e30-9048-8d54e27fce1c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:21.310191 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-cdcd010e-c652-4e30-9048-8d54e27fce1c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:21.311336 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-cdcd010e-c652-4e30-9048-8d54e27fce1c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1805 microversion: 2.20 time: 0.148097 Aug 07 04:59:21.311897 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 451/860] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:59:21 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1805 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:59:22.329159 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-211660cd-0328-48b9-80fb-124eeb2ecc4c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:59:22.329721 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-211660cd-0328-48b9-80fb-124eeb2ecc4c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:59:22.335852 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-211660cd-0328-48b9-80fb-124eeb2ecc4c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:22.336288 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-211660cd-0328-48b9-80fb-124eeb2ecc4c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:22.337330 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-211660cd-0328-48b9-80fb-124eeb2ecc4c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:22.337758 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-211660cd-0328-48b9-80fb-124eeb2ecc4c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:22.464107 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-211660cd-0328-48b9-80fb-124eeb2ecc4c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:22.473289 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-211660cd-0328-48b9-80fb-124eeb2ecc4c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:22.474919 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-211660cd-0328-48b9-80fb-124eeb2ecc4c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:22.476056 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-211660cd-0328-48b9-80fb-124eeb2ecc4c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1805 microversion: 2.20 time: 0.150727 Aug 07 04:59:22.476613 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 410/861] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:59:22 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1805 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:59:23.495205 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-cd8f099a-175e-4f95-beb1-725a4add4428 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:59:23.495799 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-cd8f099a-175e-4f95-beb1-725a4add4428 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:59:23.501579 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-cd8f099a-175e-4f95-beb1-725a4add4428 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:23.502018 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-cd8f099a-175e-4f95-beb1-725a4add4428 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:23.502992 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-cd8f099a-175e-4f95-beb1-725a4add4428 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:23.503437 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-cd8f099a-175e-4f95-beb1-725a4add4428 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:23.627528 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-cd8f099a-175e-4f95-beb1-725a4add4428 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:23.636615 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-cd8f099a-175e-4f95-beb1-725a4add4428 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:23.638111 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-cd8f099a-175e-4f95-beb1-725a4add4428 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:23.639243 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-cd8f099a-175e-4f95-beb1-725a4add4428 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1805 microversion: 2.20 time: 0.148558 Aug 07 04:59:23.639790 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 452/862] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:59:23 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1805 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:59:24.657017 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-b4618785-7f1f-43b0-927f-e193d2ba51cb tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:59:24.657620 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-b4618785-7f1f-43b0-927f-e193d2ba51cb tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:59:24.663421 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b4618785-7f1f-43b0-927f-e193d2ba51cb tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:24.663864 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b4618785-7f1f-43b0-927f-e193d2ba51cb tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:24.664616 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b4618785-7f1f-43b0-927f-e193d2ba51cb tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:24.665083 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b4618785-7f1f-43b0-927f-e193d2ba51cb tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:24.795947 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-b4618785-7f1f-43b0-927f-e193d2ba51cb tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:24.804379 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-b4618785-7f1f-43b0-927f-e193d2ba51cb tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:24.805977 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-b4618785-7f1f-43b0-927f-e193d2ba51cb tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:24.807134 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-b4618785-7f1f-43b0-927f-e193d2ba51cb tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1805 microversion: 2.20 time: 0.153822 Aug 07 04:59:24.807690 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 411/863] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:59:24 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1805 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:59:24.885927 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [req-8c90aaee-5bb8-4f26-8cde-d1610701606c req-445c0325-cb83-4cd0-b4e4-0ca8a4fcc33f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "431857b6-a453-44f0-829c-00ed610d5fc2", "name": "network-vif-plugged", "status": "completed", "tag": "6a0264c8-c45c-4fec-b570-31fbf0131107"}]} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:59:24.887522 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 04:59:24.887522 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: warnings.warn(msg) Aug 07 04:59:24.894310 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-8c90aaee-5bb8-4f26-8cde-d1610701606c req-445c0325-cb83-4cd0-b4e4-0ca8a4fcc33f service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:24.894745 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-8c90aaee-5bb8-4f26-8cde-d1610701606c req-445c0325-cb83-4cd0-b4e4-0ca8a4fcc33f service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:24.906150 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.compute.server_external_events [req-8c90aaee-5bb8-4f26-8cde-d1610701606c req-445c0325-cb83-4cd0-b4e4-0ca8a4fcc33f service nova] Creating event network-vif-plugged:6a0264c8-c45c-4fec-b570-31fbf0131107 for instance 431857b6-a453-44f0-829c-00ed610d5fc2 on hv-cinder-80374 Aug 07 04:59:24.910975 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [req-8c90aaee-5bb8-4f26-8cde-d1610701606c req-445c0325-cb83-4cd0-b4e4-0ca8a4fcc33f service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029334 Aug 07 04:59:24.911556 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 453/864] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 04:59:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:59:25.828604 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-ec4260a4-2027-4050-9b73-537136441a70 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:59:25.829664 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-ec4260a4-2027-4050-9b73-537136441a70 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:59:25.839044 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ec4260a4-2027-4050-9b73-537136441a70 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:25.840221 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ec4260a4-2027-4050-9b73-537136441a70 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:25.840349 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ec4260a4-2027-4050-9b73-537136441a70 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:25.840716 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ec4260a4-2027-4050-9b73-537136441a70 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:25.985701 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-ec4260a4-2027-4050-9b73-537136441a70 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:25.994816 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-ec4260a4-2027-4050-9b73-537136441a70 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:25.996291 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-ec4260a4-2027-4050-9b73-537136441a70 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:25.997484 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-ec4260a4-2027-4050-9b73-537136441a70 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1805 microversion: 2.20 time: 0.174460 Aug 07 04:59:25.998034 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 412/865] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:59:25 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1805 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:59:27.016431 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-7181e10e-caa3-42eb-a128-45c00b04f173 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:59:27.017178 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-7181e10e-caa3-42eb-a128-45c00b04f173 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:59:27.023113 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-7181e10e-caa3-42eb-a128-45c00b04f173 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:27.023548 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-7181e10e-caa3-42eb-a128-45c00b04f173 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:27.024305 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-7181e10e-caa3-42eb-a128-45c00b04f173 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:27.024951 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-7181e10e-caa3-42eb-a128-45c00b04f173 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:27.142743 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-7181e10e-caa3-42eb-a128-45c00b04f173 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:27.154522 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-7181e10e-caa3-42eb-a128-45c00b04f173 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:27.157093 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-7181e10e-caa3-42eb-a128-45c00b04f173 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:27.158271 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-7181e10e-caa3-42eb-a128-45c00b04f173 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1805 microversion: 2.20 time: 0.145921 Aug 07 04:59:27.158824 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 454/866] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:59:27 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1805 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:59:28.175972 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-282ae019-d364-47fd-9014-4356248dd18e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:59:28.176707 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-282ae019-d364-47fd-9014-4356248dd18e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:59:28.183530 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-282ae019-d364-47fd-9014-4356248dd18e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:28.184009 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-282ae019-d364-47fd-9014-4356248dd18e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:28.184827 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-282ae019-d364-47fd-9014-4356248dd18e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:28.185273 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-282ae019-d364-47fd-9014-4356248dd18e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:28.310785 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-282ae019-d364-47fd-9014-4356248dd18e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:28.319187 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-282ae019-d364-47fd-9014-4356248dd18e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:28.320686 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-282ae019-d364-47fd-9014-4356248dd18e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:28.322504 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-282ae019-d364-47fd-9014-4356248dd18e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1805 microversion: 2.20 time: 0.150195 Aug 07 04:59:28.323057 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 413/867] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:59:28 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1805 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:59:29.340879 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-d271170d-bb32-4998-ae44-a95e54baf060 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:59:29.341486 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-d271170d-bb32-4998-ae44-a95e54baf060 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:59:29.347327 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d271170d-bb32-4998-ae44-a95e54baf060 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:29.347767 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d271170d-bb32-4998-ae44-a95e54baf060 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:29.348520 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d271170d-bb32-4998-ae44-a95e54baf060 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:29.348976 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d271170d-bb32-4998-ae44-a95e54baf060 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:29.469943 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-d271170d-bb32-4998-ae44-a95e54baf060 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:29.478584 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-d271170d-bb32-4998-ae44-a95e54baf060 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:29.480089 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-d271170d-bb32-4998-ae44-a95e54baf060 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:29.481241 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-d271170d-bb32-4998-ae44-a95e54baf060 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1805 microversion: 2.20 time: 0.144204 Aug 07 04:59:29.481785 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 455/868] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:59:29 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1805 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:59:30.498915 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-f8096853-0049-49b5-a91d-8813ac9f5d6e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:59:30.499525 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-f8096853-0049-49b5-a91d-8813ac9f5d6e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:59:30.505379 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f8096853-0049-49b5-a91d-8813ac9f5d6e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:30.505826 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f8096853-0049-49b5-a91d-8813ac9f5d6e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:30.506592 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f8096853-0049-49b5-a91d-8813ac9f5d6e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:30.507029 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f8096853-0049-49b5-a91d-8813ac9f5d6e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:30.624443 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-f8096853-0049-49b5-a91d-8813ac9f5d6e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:30.632698 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-f8096853-0049-49b5-a91d-8813ac9f5d6e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:30.635237 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-f8096853-0049-49b5-a91d-8813ac9f5d6e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:30.636383 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-f8096853-0049-49b5-a91d-8813ac9f5d6e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1805 microversion: 2.20 time: 0.141231 Aug 07 04:59:30.636958 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 414/869] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:59:30 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1805 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 04:59:31.655167 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-43ac12d1-2cc2-471d-b142-7e59860db33a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:59:31.655772 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-43ac12d1-2cc2-471d-b142-7e59860db33a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:59:31.661707 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-43ac12d1-2cc2-471d-b142-7e59860db33a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:31.662146 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-43ac12d1-2cc2-471d-b142-7e59860db33a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:31.662906 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-43ac12d1-2cc2-471d-b142-7e59860db33a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:31.663338 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-43ac12d1-2cc2-471d-b142-7e59860db33a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:31.780388 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-43ac12d1-2cc2-471d-b142-7e59860db33a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:31.788590 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-43ac12d1-2cc2-471d-b142-7e59860db33a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:31.790232 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-43ac12d1-2cc2-471d-b142-7e59860db33a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:31.791362 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-43ac12d1-2cc2-471d-b142-7e59860db33a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1805 microversion: 2.20 time: 0.140010 Aug 07 04:59:31.791923 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 456/870] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:59:31 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1805 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:59:32.810168 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-9eb62c99-a09a-4577-82e7-20f1721728f0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:59:32.810779 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-9eb62c99-a09a-4577-82e7-20f1721728f0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:59:32.816576 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9eb62c99-a09a-4577-82e7-20f1721728f0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:32.817057 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9eb62c99-a09a-4577-82e7-20f1721728f0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:32.817838 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9eb62c99-a09a-4577-82e7-20f1721728f0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:32.818249 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9eb62c99-a09a-4577-82e7-20f1721728f0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:32.939932 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-9eb62c99-a09a-4577-82e7-20f1721728f0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:32.948757 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-9eb62c99-a09a-4577-82e7-20f1721728f0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:32.950265 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-9eb62c99-a09a-4577-82e7-20f1721728f0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:32.951397 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-9eb62c99-a09a-4577-82e7-20f1721728f0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1805 microversion: 2.20 time: 0.145872 Aug 07 04:59:32.951949 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 415/871] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:59:32 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1805 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:59:33.969584 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-ef376939-cab5-40f8-864b-bb24ee8550a9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:59:33.970194 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-ef376939-cab5-40f8-864b-bb24ee8550a9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:59:33.975992 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ef376939-cab5-40f8-864b-bb24ee8550a9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:33.976439 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ef376939-cab5-40f8-864b-bb24ee8550a9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:33.977256 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ef376939-cab5-40f8-864b-bb24ee8550a9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:33.977677 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ef376939-cab5-40f8-864b-bb24ee8550a9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:34.098966 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-ef376939-cab5-40f8-864b-bb24ee8550a9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:34.107213 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-ef376939-cab5-40f8-864b-bb24ee8550a9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:34.108703 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-ef376939-cab5-40f8-864b-bb24ee8550a9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:34.109854 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-ef376939-cab5-40f8-864b-bb24ee8550a9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1805 microversion: 2.20 time: 0.143984 Aug 07 04:59:34.110404 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 457/872] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:59:33 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1805 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:59:35.128536 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-17875af4-4707-4151-b60d-633890cb2dbb tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:59:35.129174 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-17875af4-4707-4151-b60d-633890cb2dbb tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:59:35.135252 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-17875af4-4707-4151-b60d-633890cb2dbb tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:35.135701 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-17875af4-4707-4151-b60d-633890cb2dbb tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:35.136458 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-17875af4-4707-4151-b60d-633890cb2dbb tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:35.136923 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-17875af4-4707-4151-b60d-633890cb2dbb tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:35.261758 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-17875af4-4707-4151-b60d-633890cb2dbb tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:35.269985 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-17875af4-4707-4151-b60d-633890cb2dbb tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:35.271457 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-17875af4-4707-4151-b60d-633890cb2dbb tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:35.272578 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-17875af4-4707-4151-b60d-633890cb2dbb tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1805 microversion: 2.20 time: 0.147851 Aug 07 04:59:35.273157 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 416/873] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:59:35 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1805 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:59:36.290838 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-0b385fbf-6612-4ac7-9701-53066d01aabe tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:59:36.291431 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-0b385fbf-6612-4ac7-9701-53066d01aabe tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:59:36.297249 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0b385fbf-6612-4ac7-9701-53066d01aabe tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:36.297694 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0b385fbf-6612-4ac7-9701-53066d01aabe tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:36.298463 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0b385fbf-6612-4ac7-9701-53066d01aabe tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:36.298893 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0b385fbf-6612-4ac7-9701-53066d01aabe tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:36.421557 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-0b385fbf-6612-4ac7-9701-53066d01aabe tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:36.429729 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-0b385fbf-6612-4ac7-9701-53066d01aabe tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:36.431881 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-0b385fbf-6612-4ac7-9701-53066d01aabe tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:36.433054 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-0b385fbf-6612-4ac7-9701-53066d01aabe tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1805 microversion: 2.20 time: 0.145957 Aug 07 04:59:36.433614 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 458/874] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:59:36 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1805 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:59:37.451399 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-095731a2-9495-472b-b0cf-fb67b764e5e2 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:59:37.452244 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-095731a2-9495-472b-b0cf-fb67b764e5e2 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:59:37.458019 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-095731a2-9495-472b-b0cf-fb67b764e5e2 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:37.458465 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-095731a2-9495-472b-b0cf-fb67b764e5e2 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:37.459360 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-095731a2-9495-472b-b0cf-fb67b764e5e2 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:37.459672 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-095731a2-9495-472b-b0cf-fb67b764e5e2 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:37.581759 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-095731a2-9495-472b-b0cf-fb67b764e5e2 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:37.591018 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-095731a2-9495-472b-b0cf-fb67b764e5e2 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:37.592513 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-095731a2-9495-472b-b0cf-fb67b764e5e2 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:37.593682 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-095731a2-9495-472b-b0cf-fb67b764e5e2 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1805 microversion: 2.20 time: 0.145967 Aug 07 04:59:37.594239 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 417/875] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:59:37 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1805 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 04:59:38.611550 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-3f167180-2b00-4cbf-b613-6e018be981a8 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:59:38.612151 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-3f167180-2b00-4cbf-b613-6e018be981a8 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:59:38.618713 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3f167180-2b00-4cbf-b613-6e018be981a8 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:38.619165 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3f167180-2b00-4cbf-b613-6e018be981a8 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:38.619943 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3f167180-2b00-4cbf-b613-6e018be981a8 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:38.620378 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3f167180-2b00-4cbf-b613-6e018be981a8 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:38.739219 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-3f167180-2b00-4cbf-b613-6e018be981a8 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:38.747577 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-3f167180-2b00-4cbf-b613-6e018be981a8 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:38.749102 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-3f167180-2b00-4cbf-b613-6e018be981a8 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:38.750239 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-3f167180-2b00-4cbf-b613-6e018be981a8 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1805 microversion: 2.20 time: 0.142386 Aug 07 04:59:38.750794 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 459/876] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:59:38 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1805 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:59:39.767002 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-eec379c0-5e5d-48ac-b280-0b1d574a8943 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:59:39.767602 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-eec379c0-5e5d-48ac-b280-0b1d574a8943 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:59:39.773333 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-eec379c0-5e5d-48ac-b280-0b1d574a8943 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:39.773818 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-eec379c0-5e5d-48ac-b280-0b1d574a8943 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:39.774748 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-eec379c0-5e5d-48ac-b280-0b1d574a8943 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:39.775170 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-eec379c0-5e5d-48ac-b280-0b1d574a8943 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:39.901090 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-eec379c0-5e5d-48ac-b280-0b1d574a8943 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:39.909300 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-eec379c0-5e5d-48ac-b280-0b1d574a8943 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:39.910766 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-eec379c0-5e5d-48ac-b280-0b1d574a8943 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:39.911887 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-eec379c0-5e5d-48ac-b280-0b1d574a8943 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1805 microversion: 2.20 time: 0.148557 Aug 07 04:59:39.912435 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 418/877] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:59:39 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1805 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:59:40.929824 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-561525c7-1535-477d-b21a-175fd71b0a38 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:59:40.930487 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-561525c7-1535-477d-b21a-175fd71b0a38 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:59:40.936413 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-561525c7-1535-477d-b21a-175fd71b0a38 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:40.936883 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-561525c7-1535-477d-b21a-175fd71b0a38 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:40.937668 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-561525c7-1535-477d-b21a-175fd71b0a38 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:40.938092 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-561525c7-1535-477d-b21a-175fd71b0a38 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:41.056128 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-561525c7-1535-477d-b21a-175fd71b0a38 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:41.064422 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-561525c7-1535-477d-b21a-175fd71b0a38 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:41.065923 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-561525c7-1535-477d-b21a-175fd71b0a38 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:41.067053 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-561525c7-1535-477d-b21a-175fd71b0a38 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1792 microversion: 2.20 time: 0.140942 Aug 07 04:59:41.067605 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 460/878] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 04:59:40 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1792 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 04:59:43.579204 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-4e21b300-1fec-4f9a-bbdb-ba15e53369e9 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:59:43.579859 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-4e21b300-1fec-4f9a-bbdb-ba15e53369e9 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] [instance: 28314017-c8b0-4a57-8ffb-7fa1aee0232e] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:59:43.586189 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4e21b300-1fec-4f9a-bbdb-ba15e53369e9 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:43.587851 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4e21b300-1fec-4f9a-bbdb-ba15e53369e9 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:43.588623 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4e21b300-1fec-4f9a-bbdb-ba15e53369e9 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:43.589083 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4e21b300-1fec-4f9a-bbdb-ba15e53369e9 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:43.675195 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.objects.instance [None req-4e21b300-1fec-4f9a-bbdb-ba15e53369e9 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lazy-loading 'services' on Instance uuid 28314017-c8b0-4a57-8ffb-7fa1aee0232e {{(pid=107485) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 04:59:43.737301 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-4e21b300-1fec-4f9a-bbdb-ba15e53369e9 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] 10.222.0.35 "DELETE /compute/v2.1/servers/28314017-c8b0-4a57-8ffb-7fa1aee0232e/os-volume_attachments/1d24853e-12b0-4600-8711-7e4236bdf1e5" status: 202 len: 0 microversion: 2.1 time: 0.162045 Aug 07 04:59:43.737868 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 419/879] 10.222.0.35 () {58 vars in 1416 bytes} [Sat Aug 7 04:59:43 2021] DELETE /compute/v2.1/servers/28314017-c8b0-4a57-8ffb-7fa1aee0232e/os-volume_attachments/1d24853e-12b0-4600-8711-7e4236bdf1e5 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 04:59:44.852352 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-9b51ce44-8ebd-4e84-846d-b3ef7a9af21b tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:59:44.852872 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-9b51ce44-8ebd-4e84-846d-b3ef7a9af21b tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] [instance: 28314017-c8b0-4a57-8ffb-7fa1aee0232e] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:59:44.858895 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9b51ce44-8ebd-4e84-846d-b3ef7a9af21b tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:44.859344 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9b51ce44-8ebd-4e84-846d-b3ef7a9af21b tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:44.860108 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9b51ce44-8ebd-4e84-846d-b3ef7a9af21b tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:44.860540 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9b51ce44-8ebd-4e84-846d-b3ef7a9af21b tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:44.885697 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-9b51ce44-8ebd-4e84-846d-b3ef7a9af21b tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] [instance: 28314017-c8b0-4a57-8ffb-7fa1aee0232e] Going to try to terminate instance {{(pid=107486) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 07 04:59:44.956162 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-9b51ce44-8ebd-4e84-846d-b3ef7a9af21b tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] 10.222.0.35 "DELETE /compute/v2.1/servers/28314017-c8b0-4a57-8ffb-7fa1aee0232e" status: 204 len: 0 microversion: 2.1 time: 0.107191 Aug 07 04:59:44.957016 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 461/880] 10.222.0.35 () {58 vars in 1239 bytes} [Sat Aug 7 04:59:44 2021] DELETE /compute/v2.1/servers/28314017-c8b0-4a57-8ffb-7fa1aee0232e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 04:59:44.965466 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-78309a86-fa49-4358-a9ef-ca322e564098 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:59:44.966174 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-78309a86-fa49-4358-a9ef-ca322e564098 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] [instance: 28314017-c8b0-4a57-8ffb-7fa1aee0232e] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:59:44.972153 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-78309a86-fa49-4358-a9ef-ca322e564098 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:44.972603 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-78309a86-fa49-4358-a9ef-ca322e564098 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:44.973384 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-78309a86-fa49-4358-a9ef-ca322e564098 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:44.973844 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-78309a86-fa49-4358-a9ef-ca322e564098 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:45.104729 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-78309a86-fa49-4358-a9ef-ca322e564098 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd371b9690a4fe192c4cdf0b4d9900b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5e22820a1410d94c298e75220eb68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:45.112173 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-78309a86-fa49-4358-a9ef-ca322e564098 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] 10.222.0.35 "GET /compute/v2.1/servers/28314017-c8b0-4a57-8ffb-7fa1aee0232e" status: 200 len: 1512 microversion: 2.1 time: 0.151087 Aug 07 04:59:45.112731 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 420/881] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:59:44 2021] GET /compute/v2.1/servers/28314017-c8b0-4a57-8ffb-7fa1aee0232e => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:59:46.129865 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-a4890084-6d7b-40c6-82ee-16b14009064d tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:59:46.130649 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-a4890084-6d7b-40c6-82ee-16b14009064d tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] [instance: 28314017-c8b0-4a57-8ffb-7fa1aee0232e] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:59:46.138410 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a4890084-6d7b-40c6-82ee-16b14009064d tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:46.138866 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a4890084-6d7b-40c6-82ee-16b14009064d tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:46.139641 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a4890084-6d7b-40c6-82ee-16b14009064d tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:46.140077 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a4890084-6d7b-40c6-82ee-16b14009064d tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:46.267897 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-a4890084-6d7b-40c6-82ee-16b14009064d tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd371b9690a4fe192c4cdf0b4d9900b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5e22820a1410d94c298e75220eb68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:46.275733 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-a4890084-6d7b-40c6-82ee-16b14009064d tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] 10.222.0.35 "GET /compute/v2.1/servers/28314017-c8b0-4a57-8ffb-7fa1aee0232e" status: 200 len: 1512 microversion: 2.1 time: 0.149367 Aug 07 04:59:46.276447 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 462/882] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:59:46 2021] GET /compute/v2.1/servers/28314017-c8b0-4a57-8ffb-7fa1aee0232e => generated 1512 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:59:47.292448 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-58505ef1-8152-4402-8eae-d15a61da31f4 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:59:47.293393 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-58505ef1-8152-4402-8eae-d15a61da31f4 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] [instance: 28314017-c8b0-4a57-8ffb-7fa1aee0232e] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:59:47.299426 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-58505ef1-8152-4402-8eae-d15a61da31f4 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:47.300061 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-58505ef1-8152-4402-8eae-d15a61da31f4 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:47.300881 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-58505ef1-8152-4402-8eae-d15a61da31f4 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:47.301287 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-58505ef1-8152-4402-8eae-d15a61da31f4 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:47.501889 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-58505ef1-8152-4402-8eae-d15a61da31f4 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd371b9690a4fe192c4cdf0b4d9900b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5e22820a1410d94c298e75220eb68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 04:59:47.510077 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-58505ef1-8152-4402-8eae-d15a61da31f4 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] 10.222.0.35 "GET /compute/v2.1/servers/28314017-c8b0-4a57-8ffb-7fa1aee0232e" status: 200 len: 1512 microversion: 2.1 time: 0.221164 Aug 07 04:59:47.510764 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 421/883] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:59:47 2021] GET /compute/v2.1/servers/28314017-c8b0-4a57-8ffb-7fa1aee0232e => generated 1512 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 04:59:47.823913 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [req-266e5141-897a-4773-a593-45b14f375c6e req-5bffe85d-adf0-4da3-a82e-87172fdbf101 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28314017-c8b0-4a57-8ffb-7fa1aee0232e", "name": "network-vif-deleted", "tag": "2fb5165d-bfbf-4de5-8df3-bb9fe0d27b45"}]} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 04:59:47.826291 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 04:59:47.826291 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: warnings.warn(msg) Aug 07 04:59:47.834050 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-266e5141-897a-4773-a593-45b14f375c6e req-5bffe85d-adf0-4da3-a82e-87172fdbf101 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:47.834481 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-266e5141-897a-4773-a593-45b14f375c6e req-5bffe85d-adf0-4da3-a82e-87172fdbf101 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:47.846053 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.compute.server_external_events [req-266e5141-897a-4773-a593-45b14f375c6e req-5bffe85d-adf0-4da3-a82e-87172fdbf101 service nova] Creating event network-vif-deleted:2fb5165d-bfbf-4de5-8df3-bb9fe0d27b45 for instance 28314017-c8b0-4a57-8ffb-7fa1aee0232e on hv-cinder-80374 Aug 07 04:59:47.850660 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [req-266e5141-897a-4773-a593-45b14f375c6e req-5bffe85d-adf0-4da3-a82e-87172fdbf101 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169406 Aug 07 04:59:47.851245 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 463/884] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 04:59:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 04:59:48.527298 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-da990bd9-bf07-4271-b0f2-8a73071ef22a tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 04:59:48.527944 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-da990bd9-bf07-4271-b0f2-8a73071ef22a tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] [instance: 28314017-c8b0-4a57-8ffb-7fa1aee0232e] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 04:59:48.533718 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-da990bd9-bf07-4271-b0f2-8a73071ef22a tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:48.534154 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-da990bd9-bf07-4271-b0f2-8a73071ef22a tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:48.534912 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-da990bd9-bf07-4271-b0f2-8a73071ef22a tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 04:59:48.535340 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-da990bd9-bf07-4271-b0f2-8a73071ef22a tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 04:59:48.548763 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.wsgi [None req-da990bd9-bf07-4271-b0f2-8a73071ef22a tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] HTTP exception thrown: Instance 28314017-c8b0-4a57-8ffb-7fa1aee0232e could not be found. Aug 07 04:59:48.549368 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-da990bd9-bf07-4271-b0f2-8a73071ef22a tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Returning 404 to user: Instance 28314017-c8b0-4a57-8ffb-7fa1aee0232e could not be found. {{(pid=107485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 07 04:59:48.550296 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-da990bd9-bf07-4271-b0f2-8a73071ef22a tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] 10.222.0.35 "GET /compute/v2.1/servers/28314017-c8b0-4a57-8ffb-7fa1aee0232e" status: 404 len: 111 microversion: 2.1 time: 0.027204 Aug 07 04:59:48.550821 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 422/885] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 04:59:48 2021] GET /compute/v2.1/servers/28314017-c8b0-4a57-8ffb-7fa1aee0232e => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 05:00:03.488742 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-ba618eb2-2793-4a3c-9f74-473aa45f842c tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-340496794", "imageRef": "ddcf95b5-3ea4-4a61-8f54-4b2feadb8682", "flavorRef": "452", "networks": [{"uuid": "25fcf950-049f-4351-99b7-944505ca0693"}]}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:00:03.540544 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.network.neutron [None req-ba618eb2-2793-4a3c-9f74-473aa45f842c tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] validate_networks() for [('25fcf950-049f-4351-99b7-944505ca0693', None, None, None)] {{(pid=107486) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 07 05:00:03.967149 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.virt.hardware [None req-ba618eb2-2793-4a3c-9f74-473aa45f842c tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Flavor limits 0:0:0 {{(pid=107486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 05:00:03.967577 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.virt.hardware [None req-ba618eb2-2793-4a3c-9f74-473aa45f842c tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Image limits 0:0:0 {{(pid=107486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 05:00:03.968052 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.virt.hardware [None req-ba618eb2-2793-4a3c-9f74-473aa45f842c tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Flavor pref 0:0:0 {{(pid=107486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 05:00:03.968463 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.virt.hardware [None req-ba618eb2-2793-4a3c-9f74-473aa45f842c tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Image pref 0:0:0 {{(pid=107486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 05:00:03.968907 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.virt.hardware [None req-ba618eb2-2793-4a3c-9f74-473aa45f842c tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 05:00:03.978437 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ba618eb2-2793-4a3c-9f74-473aa45f842c tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:03.978879 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ba618eb2-2793-4a3c-9f74-473aa45f842c tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:03.980198 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ba618eb2-2793-4a3c-9f74-473aa45f842c tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:03.980633 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ba618eb2-2793-4a3c-9f74-473aa45f842c tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:03.997796 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.quota [None req-ba618eb2-2793-4a3c-9f74-473aa45f842c tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Getting quotas for project 2df5e22820a1410d94c298e75220eb68. Resources: {'ram', 'cores', 'instances'} {{(pid=107486) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 07 05:00:04.001658 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.quota [None req-ba618eb2-2793-4a3c-9f74-473aa45f842c tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Getting quotas for user 3dd371b9690a4fe192c4cdf0b4d9900b and project 2df5e22820a1410d94c298e75220eb68. Resources: {'ram', 'cores', 'instances'} {{(pid=107486) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 07 05:00:04.013207 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-ba618eb2-2793-4a3c-9f74-473aa45f842c tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Going to run 1 instances... {{(pid=107486) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 07 05:00:04.015576 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-ba618eb2-2793-4a3c-9f74-473aa45f842c tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] [instance: 57c03d68-3927-4635-9ba1-7daeae99793f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ddcf95b5-3ea4-4a61-8f54-4b2feadb8682',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107486) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 07 05:00:04.060325 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-ba618eb2-2793-4a3c-9f74-473aa45f842c tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.575635 Aug 07 05:00:04.060986 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 464/886] 10.222.0.35 () {60 vars in 1147 bytes} [Sat Aug 7 05:00:03 2021] POST /compute/v2.1/servers => generated 380 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 05:00:04.068233 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b2f3e8fe-f2eb-433e-81aa-98acf8a082e1] AMQP server on 10.222.0.35:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 07 05:00:04.071595 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-06012585-b7a6-49d2-bfaf-68f4d76df174 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:00:04.072341 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-06012585-b7a6-49d2-bfaf-68f4d76df174 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] [instance: 57c03d68-3927-4635-9ba1-7daeae99793f] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:00:04.129509 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-06012585-b7a6-49d2-bfaf-68f4d76df174 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd371b9690a4fe192c4cdf0b4d9900b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5e22820a1410d94c298e75220eb68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:00:04.137472 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-06012585-b7a6-49d2-bfaf-68f4d76df174 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] 10.222.0.35 "GET /compute/v2.1/servers/57c03d68-3927-4635-9ba1-7daeae99793f" status: 200 len: 1218 microversion: 2.1 time: 0.070645 Aug 07 05:00:04.138027 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 423/887] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:00:04 2021] GET /compute/v2.1/servers/57c03d68-3927-4635-9ba1-7daeae99793f => generated 1218 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:00:05.154990 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-c9ac0793-02f4-45bc-bd62-8311d0c83b16 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:00:05.155643 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-c9ac0793-02f4-45bc-bd62-8311d0c83b16 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] [instance: 57c03d68-3927-4635-9ba1-7daeae99793f] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:00:05.161971 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c9ac0793-02f4-45bc-bd62-8311d0c83b16 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:05.162438 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c9ac0793-02f4-45bc-bd62-8311d0c83b16 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:05.163194 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c9ac0793-02f4-45bc-bd62-8311d0c83b16 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:05.163631 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c9ac0793-02f4-45bc-bd62-8311d0c83b16 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:05.221999 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-c9ac0793-02f4-45bc-bd62-8311d0c83b16 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd371b9690a4fe192c4cdf0b4d9900b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5e22820a1410d94c298e75220eb68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:00:05.229062 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-c9ac0793-02f4-45bc-bd62-8311d0c83b16 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] 10.222.0.35 "GET /compute/v2.1/servers/57c03d68-3927-4635-9ba1-7daeae99793f" status: 200 len: 1222 microversion: 2.1 time: 0.078660 Aug 07 05:00:05.229671 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 465/888] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:00:05 2021] GET /compute/v2.1/servers/57c03d68-3927-4635-9ba1-7daeae99793f => generated 1222 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:00:06.246202 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-17ab038a-6c54-4d35-b6bc-d84dd9a4917d tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:00:06.246812 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-17ab038a-6c54-4d35-b6bc-d84dd9a4917d tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] [instance: 57c03d68-3927-4635-9ba1-7daeae99793f] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:00:06.266418 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-17ab038a-6c54-4d35-b6bc-d84dd9a4917d tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:06.266867 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-17ab038a-6c54-4d35-b6bc-d84dd9a4917d tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:06.267637 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-17ab038a-6c54-4d35-b6bc-d84dd9a4917d tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:06.268070 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-17ab038a-6c54-4d35-b6bc-d84dd9a4917d tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:06.273357 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO oslo.messaging._drivers.impl_rabbit [-] [b2f3e8fe-f2eb-433e-81aa-98acf8a082e1] Reconnected to AMQP server on 10.222.0.35:5672 via [amqp] client with port 53300. Aug 07 05:00:06.326918 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-17ab038a-6c54-4d35-b6bc-d84dd9a4917d tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd371b9690a4fe192c4cdf0b4d9900b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5e22820a1410d94c298e75220eb68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:00:06.334247 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-17ab038a-6c54-4d35-b6bc-d84dd9a4917d tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] 10.222.0.35 "GET /compute/v2.1/servers/57c03d68-3927-4635-9ba1-7daeae99793f" status: 200 len: 1222 microversion: 2.1 time: 0.092374 Aug 07 05:00:06.337119 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 424/889] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:00:06 2021] GET /compute/v2.1/servers/57c03d68-3927-4635-9ba1-7daeae99793f => generated 1222 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:00:07.350197 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-d9f1a7c9-b3f4-4cee-aa6f-731c75df3dc8 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:00:07.350793 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-d9f1a7c9-b3f4-4cee-aa6f-731c75df3dc8 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] [instance: 57c03d68-3927-4635-9ba1-7daeae99793f] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:00:07.357553 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d9f1a7c9-b3f4-4cee-aa6f-731c75df3dc8 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:07.357995 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d9f1a7c9-b3f4-4cee-aa6f-731c75df3dc8 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:07.358757 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d9f1a7c9-b3f4-4cee-aa6f-731c75df3dc8 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:07.359190 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d9f1a7c9-b3f4-4cee-aa6f-731c75df3dc8 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:07.416144 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-d9f1a7c9-b3f4-4cee-aa6f-731c75df3dc8 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd371b9690a4fe192c4cdf0b4d9900b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5e22820a1410d94c298e75220eb68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:00:07.423713 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-d9f1a7c9-b3f4-4cee-aa6f-731c75df3dc8 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] 10.222.0.35 "GET /compute/v2.1/servers/57c03d68-3927-4635-9ba1-7daeae99793f" status: 200 len: 1270 microversion: 2.1 time: 0.077203 Aug 07 05:00:07.424279 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 466/890] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:00:07 2021] GET /compute/v2.1/servers/57c03d68-3927-4635-9ba1-7daeae99793f => generated 1270 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:00:08.440972 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-81780e5a-3efd-47fe-a6cf-ec1a11816745 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:00:08.442295 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-81780e5a-3efd-47fe-a6cf-ec1a11816745 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] [instance: 57c03d68-3927-4635-9ba1-7daeae99793f] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:00:08.448304 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-81780e5a-3efd-47fe-a6cf-ec1a11816745 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:08.448951 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-81780e5a-3efd-47fe-a6cf-ec1a11816745 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:08.449740 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-81780e5a-3efd-47fe-a6cf-ec1a11816745 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:08.450179 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-81780e5a-3efd-47fe-a6cf-ec1a11816745 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:08.637931 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-81780e5a-3efd-47fe-a6cf-ec1a11816745 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd371b9690a4fe192c4cdf0b4d9900b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5e22820a1410d94c298e75220eb68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:00:08.645193 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-81780e5a-3efd-47fe-a6cf-ec1a11816745 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] 10.222.0.35 "GET /compute/v2.1/servers/57c03d68-3927-4635-9ba1-7daeae99793f" status: 200 len: 1318 microversion: 2.1 time: 0.208233 Aug 07 05:00:08.646085 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 425/891] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:00:08 2021] GET /compute/v2.1/servers/57c03d68-3927-4635-9ba1-7daeae99793f => generated 1318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:00:09.227554 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [req-2938b913-5d77-43a8-9156-689cef74b1ab req-4097b81f-c989-44c2-b194-f358c5a68fa8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57c03d68-3927-4635-9ba1-7daeae99793f", "tag": "cf47d2d3-865a-452e-a12f-2fb0e2eae36b"}]} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:00:09.229610 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 05:00:09.229610 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: warnings.warn(msg) Aug 07 05:00:09.237732 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-2938b913-5d77-43a8-9156-689cef74b1ab req-4097b81f-c989-44c2-b194-f358c5a68fa8 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:09.238308 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-2938b913-5d77-43a8-9156-689cef74b1ab req-4097b81f-c989-44c2-b194-f358c5a68fa8 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:09.249878 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.compute.server_external_events [req-2938b913-5d77-43a8-9156-689cef74b1ab req-4097b81f-c989-44c2-b194-f358c5a68fa8 service nova] Creating event network-changed:cf47d2d3-865a-452e-a12f-2fb0e2eae36b for instance 57c03d68-3927-4635-9ba1-7daeae99793f on hv-cinder-80374 Aug 07 05:00:09.254616 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [req-2938b913-5d77-43a8-9156-689cef74b1ab req-4097b81f-c989-44c2-b194-f358c5a68fa8 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030882 Aug 07 05:00:09.255206 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 467/892] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 05:00:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 05:00:09.662651 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-8fc32804-e106-4f62-8872-8a577805c760 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:00:09.663264 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-8fc32804-e106-4f62-8872-8a577805c760 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] [instance: 57c03d68-3927-4635-9ba1-7daeae99793f] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:00:09.669294 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8fc32804-e106-4f62-8872-8a577805c760 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:09.669744 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8fc32804-e106-4f62-8872-8a577805c760 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:09.670509 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8fc32804-e106-4f62-8872-8a577805c760 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:09.670946 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8fc32804-e106-4f62-8872-8a577805c760 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:09.789100 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-8fc32804-e106-4f62-8872-8a577805c760 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd371b9690a4fe192c4cdf0b4d9900b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5e22820a1410d94c298e75220eb68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:00:09.796368 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-8fc32804-e106-4f62-8872-8a577805c760 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] 10.222.0.35 "GET /compute/v2.1/servers/57c03d68-3927-4635-9ba1-7daeae99793f" status: 200 len: 1318 microversion: 2.1 time: 0.137429 Aug 07 05:00:09.796958 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 426/893] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:00:09 2021] GET /compute/v2.1/servers/57c03d68-3927-4635-9ba1-7daeae99793f => generated 1318 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:00:10.814285 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-df2b49a5-8572-4289-8a86-4406c88a14ce tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:00:10.814974 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-df2b49a5-8572-4289-8a86-4406c88a14ce tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] [instance: 57c03d68-3927-4635-9ba1-7daeae99793f] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:00:10.821148 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-df2b49a5-8572-4289-8a86-4406c88a14ce tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:10.821595 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-df2b49a5-8572-4289-8a86-4406c88a14ce tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:10.822352 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-df2b49a5-8572-4289-8a86-4406c88a14ce tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:10.823398 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-df2b49a5-8572-4289-8a86-4406c88a14ce tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:10.947138 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-df2b49a5-8572-4289-8a86-4406c88a14ce tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd371b9690a4fe192c4cdf0b4d9900b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5e22820a1410d94c298e75220eb68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:00:10.954941 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-df2b49a5-8572-4289-8a86-4406c88a14ce tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] 10.222.0.35 "GET /compute/v2.1/servers/57c03d68-3927-4635-9ba1-7daeae99793f" status: 200 len: 1318 microversion: 2.1 time: 0.144850 Aug 07 05:00:10.955499 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 468/894] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:00:10 2021] GET /compute/v2.1/servers/57c03d68-3927-4635-9ba1-7daeae99793f => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:00:11.971983 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-004874e8-6974-4ec0-b56e-fc06c5c76871 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:00:11.972595 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-004874e8-6974-4ec0-b56e-fc06c5c76871 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] [instance: 57c03d68-3927-4635-9ba1-7daeae99793f] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:00:11.978451 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-004874e8-6974-4ec0-b56e-fc06c5c76871 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:11.978902 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-004874e8-6974-4ec0-b56e-fc06c5c76871 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:11.979695 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-004874e8-6974-4ec0-b56e-fc06c5c76871 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:11.980126 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-004874e8-6974-4ec0-b56e-fc06c5c76871 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:12.104569 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-004874e8-6974-4ec0-b56e-fc06c5c76871 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd371b9690a4fe192c4cdf0b4d9900b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5e22820a1410d94c298e75220eb68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:00:12.111634 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-004874e8-6974-4ec0-b56e-fc06c5c76871 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] 10.222.0.35 "GET /compute/v2.1/servers/57c03d68-3927-4635-9ba1-7daeae99793f" status: 200 len: 1318 microversion: 2.1 time: 0.143484 Aug 07 05:00:12.112210 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 427/895] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:00:11 2021] GET /compute/v2.1/servers/57c03d68-3927-4635-9ba1-7daeae99793f => generated 1318 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:00:13.128320 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-bffe0e14-766c-4103-a1a2-5da2e1e58820 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:00:13.128950 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-bffe0e14-766c-4103-a1a2-5da2e1e58820 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] [instance: 57c03d68-3927-4635-9ba1-7daeae99793f] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:00:13.134849 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-bffe0e14-766c-4103-a1a2-5da2e1e58820 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:13.135331 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-bffe0e14-766c-4103-a1a2-5da2e1e58820 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:13.136151 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-bffe0e14-766c-4103-a1a2-5da2e1e58820 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:13.136579 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-bffe0e14-766c-4103-a1a2-5da2e1e58820 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:13.255802 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-bffe0e14-766c-4103-a1a2-5da2e1e58820 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd371b9690a4fe192c4cdf0b4d9900b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5e22820a1410d94c298e75220eb68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:00:13.263043 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-bffe0e14-766c-4103-a1a2-5da2e1e58820 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] 10.222.0.35 "GET /compute/v2.1/servers/57c03d68-3927-4635-9ba1-7daeae99793f" status: 200 len: 1318 microversion: 2.1 time: 0.138393 Aug 07 05:00:13.263602 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 469/896] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:00:13 2021] GET /compute/v2.1/servers/57c03d68-3927-4635-9ba1-7daeae99793f => generated 1318 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:00:14.280276 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-b5a38ad8-2d82-49bb-8a58-4fae37eb35d0 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:00:14.280839 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-b5a38ad8-2d82-49bb-8a58-4fae37eb35d0 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] [instance: 57c03d68-3927-4635-9ba1-7daeae99793f] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:00:14.286512 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b5a38ad8-2d82-49bb-8a58-4fae37eb35d0 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:14.286950 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b5a38ad8-2d82-49bb-8a58-4fae37eb35d0 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:14.287700 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b5a38ad8-2d82-49bb-8a58-4fae37eb35d0 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:14.288130 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b5a38ad8-2d82-49bb-8a58-4fae37eb35d0 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:14.406491 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-b5a38ad8-2d82-49bb-8a58-4fae37eb35d0 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd371b9690a4fe192c4cdf0b4d9900b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5e22820a1410d94c298e75220eb68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:00:14.413593 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-b5a38ad8-2d82-49bb-8a58-4fae37eb35d0 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] 10.222.0.35 "GET /compute/v2.1/servers/57c03d68-3927-4635-9ba1-7daeae99793f" status: 200 len: 1318 microversion: 2.1 time: 0.138022 Aug 07 05:00:14.414151 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 428/897] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:00:14 2021] GET /compute/v2.1/servers/57c03d68-3927-4635-9ba1-7daeae99793f => generated 1318 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:00:15.429147 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-eabbe862-b5f4-4c7c-a877-d607c9082f53 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:00:15.429762 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-eabbe862-b5f4-4c7c-a877-d607c9082f53 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] [instance: 57c03d68-3927-4635-9ba1-7daeae99793f] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:00:15.436384 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-eabbe862-b5f4-4c7c-a877-d607c9082f53 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:15.436936 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-eabbe862-b5f4-4c7c-a877-d607c9082f53 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:15.437766 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-eabbe862-b5f4-4c7c-a877-d607c9082f53 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:15.438283 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-eabbe862-b5f4-4c7c-a877-d607c9082f53 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:15.562516 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-eabbe862-b5f4-4c7c-a877-d607c9082f53 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd371b9690a4fe192c4cdf0b4d9900b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5e22820a1410d94c298e75220eb68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:00:15.569828 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-eabbe862-b5f4-4c7c-a877-d607c9082f53 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] 10.222.0.35 "GET /compute/v2.1/servers/57c03d68-3927-4635-9ba1-7daeae99793f" status: 200 len: 1318 microversion: 2.1 time: 0.144230 Aug 07 05:00:15.570394 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 470/898] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:00:15 2021] GET /compute/v2.1/servers/57c03d68-3927-4635-9ba1-7daeae99793f => generated 1318 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:00:16.587152 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-d4fde6c3-f841-417b-a973-6df47e320a8b tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:00:16.587889 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-d4fde6c3-f841-417b-a973-6df47e320a8b tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] [instance: 57c03d68-3927-4635-9ba1-7daeae99793f] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:00:16.594639 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d4fde6c3-f841-417b-a973-6df47e320a8b tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:16.595066 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d4fde6c3-f841-417b-a973-6df47e320a8b tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:16.595819 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d4fde6c3-f841-417b-a973-6df47e320a8b tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:16.596484 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d4fde6c3-f841-417b-a973-6df47e320a8b tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:16.721504 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-d4fde6c3-f841-417b-a973-6df47e320a8b tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd371b9690a4fe192c4cdf0b4d9900b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5e22820a1410d94c298e75220eb68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:00:16.729186 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-d4fde6c3-f841-417b-a973-6df47e320a8b tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] 10.222.0.35 "GET /compute/v2.1/servers/57c03d68-3927-4635-9ba1-7daeae99793f" status: 200 len: 1318 microversion: 2.1 time: 0.146101 Aug 07 05:00:16.734126 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 429/899] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:00:16 2021] GET /compute/v2.1/servers/57c03d68-3927-4635-9ba1-7daeae99793f => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:00:17.746021 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-16cd4dea-7fd1-4842-bffe-b1a3f631086d tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:00:17.746629 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-16cd4dea-7fd1-4842-bffe-b1a3f631086d tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] [instance: 57c03d68-3927-4635-9ba1-7daeae99793f] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:00:17.752304 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-16cd4dea-7fd1-4842-bffe-b1a3f631086d tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:17.752745 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-16cd4dea-7fd1-4842-bffe-b1a3f631086d tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:17.753557 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-16cd4dea-7fd1-4842-bffe-b1a3f631086d tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:17.753986 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-16cd4dea-7fd1-4842-bffe-b1a3f631086d tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:17.874939 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-16cd4dea-7fd1-4842-bffe-b1a3f631086d tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd371b9690a4fe192c4cdf0b4d9900b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5e22820a1410d94c298e75220eb68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:00:17.882099 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-16cd4dea-7fd1-4842-bffe-b1a3f631086d tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] 10.222.0.35 "GET /compute/v2.1/servers/57c03d68-3927-4635-9ba1-7daeae99793f" status: 200 len: 1318 microversion: 2.1 time: 0.139860 Aug 07 05:00:17.882661 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 471/900] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:00:17 2021] GET /compute/v2.1/servers/57c03d68-3927-4635-9ba1-7daeae99793f => generated 1318 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:00:18.898926 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-477f85df-2dd1-4a35-9e9c-0b6a994d4b9f tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:00:18.899518 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-477f85df-2dd1-4a35-9e9c-0b6a994d4b9f tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] [instance: 57c03d68-3927-4635-9ba1-7daeae99793f] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:00:18.905834 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-477f85df-2dd1-4a35-9e9c-0b6a994d4b9f tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:18.906283 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-477f85df-2dd1-4a35-9e9c-0b6a994d4b9f tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:18.907047 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-477f85df-2dd1-4a35-9e9c-0b6a994d4b9f tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:18.907482 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-477f85df-2dd1-4a35-9e9c-0b6a994d4b9f tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:19.031391 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-477f85df-2dd1-4a35-9e9c-0b6a994d4b9f tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd371b9690a4fe192c4cdf0b4d9900b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5e22820a1410d94c298e75220eb68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:00:19.039324 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-477f85df-2dd1-4a35-9e9c-0b6a994d4b9f tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] 10.222.0.35 "GET /compute/v2.1/servers/57c03d68-3927-4635-9ba1-7daeae99793f" status: 200 len: 1318 microversion: 2.1 time: 0.144111 Aug 07 05:00:19.039929 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 430/901] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:00:18 2021] GET /compute/v2.1/servers/57c03d68-3927-4635-9ba1-7daeae99793f => generated 1318 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:00:19.330429 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [req-813141ae-6630-4f3c-974d-1b31d47f7f66 req-6b4410bb-b521-455b-8bb5-d60342cdd59e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57c03d68-3927-4635-9ba1-7daeae99793f", "name": "network-vif-plugged", "status": "completed", "tag": "cf47d2d3-865a-452e-a12f-2fb0e2eae36b"}]} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:00:19.332003 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 05:00:19.332003 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: warnings.warn(msg) Aug 07 05:00:19.339862 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-813141ae-6630-4f3c-974d-1b31d47f7f66 req-6b4410bb-b521-455b-8bb5-d60342cdd59e service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:19.340355 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-813141ae-6630-4f3c-974d-1b31d47f7f66 req-6b4410bb-b521-455b-8bb5-d60342cdd59e service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:19.351419 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.compute.server_external_events [req-813141ae-6630-4f3c-974d-1b31d47f7f66 req-6b4410bb-b521-455b-8bb5-d60342cdd59e service nova] Creating event network-vif-plugged:cf47d2d3-865a-452e-a12f-2fb0e2eae36b for instance 57c03d68-3927-4635-9ba1-7daeae99793f on hv-cinder-80374 Aug 07 05:00:19.358079 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [req-813141ae-6630-4f3c-974d-1b31d47f7f66 req-6b4410bb-b521-455b-8bb5-d60342cdd59e service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151042 Aug 07 05:00:19.358649 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 472/902] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 05:00:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 05:00:20.056117 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-35d72984-51ef-49dd-a090-ea13345f0ef8 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:00:20.057556 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-35d72984-51ef-49dd-a090-ea13345f0ef8 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] [instance: 57c03d68-3927-4635-9ba1-7daeae99793f] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:00:20.063517 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-35d72984-51ef-49dd-a090-ea13345f0ef8 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:20.063963 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-35d72984-51ef-49dd-a090-ea13345f0ef8 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:20.064725 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-35d72984-51ef-49dd-a090-ea13345f0ef8 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:20.065188 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-35d72984-51ef-49dd-a090-ea13345f0ef8 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:20.188764 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-35d72984-51ef-49dd-a090-ea13345f0ef8 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd371b9690a4fe192c4cdf0b4d9900b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5e22820a1410d94c298e75220eb68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:00:20.195809 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-35d72984-51ef-49dd-a090-ea13345f0ef8 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] 10.222.0.35 "GET /compute/v2.1/servers/57c03d68-3927-4635-9ba1-7daeae99793f" status: 200 len: 1318 microversion: 2.1 time: 0.143370 Aug 07 05:00:20.196546 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 431/903] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:00:20 2021] GET /compute/v2.1/servers/57c03d68-3927-4635-9ba1-7daeae99793f => generated 1318 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:00:21.214520 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-d83ab1d4-39b2-48f2-b3e5-21921fe3a6fd tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:00:21.215203 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-d83ab1d4-39b2-48f2-b3e5-21921fe3a6fd tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] [instance: 57c03d68-3927-4635-9ba1-7daeae99793f] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:00:21.221313 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d83ab1d4-39b2-48f2-b3e5-21921fe3a6fd tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:21.221756 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d83ab1d4-39b2-48f2-b3e5-21921fe3a6fd tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:21.222511 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d83ab1d4-39b2-48f2-b3e5-21921fe3a6fd tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:21.222938 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d83ab1d4-39b2-48f2-b3e5-21921fe3a6fd tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:21.351094 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-d83ab1d4-39b2-48f2-b3e5-21921fe3a6fd tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd371b9690a4fe192c4cdf0b4d9900b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5e22820a1410d94c298e75220eb68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:00:21.359342 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-d83ab1d4-39b2-48f2-b3e5-21921fe3a6fd tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] 10.222.0.35 "GET /compute/v2.1/servers/57c03d68-3927-4635-9ba1-7daeae99793f" status: 200 len: 1318 microversion: 2.1 time: 0.149585 Aug 07 05:00:21.359898 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 473/904] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:00:21 2021] GET /compute/v2.1/servers/57c03d68-3927-4635-9ba1-7daeae99793f => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:00:21.424386 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-192d9547-f582-4725-9091-c20c183c24a0 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:00:21.424905 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-192d9547-f582-4725-9091-c20c183c24a0 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 9842981a-3233-41c1-a42b-442492d50f3a] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:00:21.430647 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-192d9547-f582-4725-9091-c20c183c24a0 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:21.431109 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-192d9547-f582-4725-9091-c20c183c24a0 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:21.432015 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-192d9547-f582-4725-9091-c20c183c24a0 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:21.432445 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-192d9547-f582-4725-9091-c20c183c24a0 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:21.456972 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-192d9547-f582-4725-9091-c20c183c24a0 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 9842981a-3233-41c1-a42b-442492d50f3a] Going to try to terminate instance {{(pid=107485) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 07 05:00:21.529846 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-192d9547-f582-4725-9091-c20c183c24a0 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "DELETE /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a" status: 204 len: 0 microversion: 2.1 time: 0.108722 Aug 07 05:00:21.530435 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 432/905] 10.222.0.35 () {58 vars in 1239 bytes} [Sat Aug 7 05:00:21 2021] DELETE /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 05:00:21.538633 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-9247af4b-7b46-4ebe-8239-0a7fe7c90e48 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:00:21.539241 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-9247af4b-7b46-4ebe-8239-0a7fe7c90e48 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 9842981a-3233-41c1-a42b-442492d50f3a] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:00:21.545827 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9247af4b-7b46-4ebe-8239-0a7fe7c90e48 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:21.546272 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9247af4b-7b46-4ebe-8239-0a7fe7c90e48 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:21.547049 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9247af4b-7b46-4ebe-8239-0a7fe7c90e48 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:21.547479 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9247af4b-7b46-4ebe-8239-0a7fe7c90e48 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:21.668253 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-9247af4b-7b46-4ebe-8239-0a7fe7c90e48 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:00:21.675619 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-9247af4b-7b46-4ebe-8239-0a7fe7c90e48 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a" status: 200 len: 1576 microversion: 2.1 time: 0.140702 Aug 07 05:00:21.676168 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 474/906] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:00:21 2021] GET /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a => generated 1576 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:00:22.376338 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-fbc2db63-8a7a-4f2b-9dea-9a0429a80916 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:00:22.377069 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-fbc2db63-8a7a-4f2b-9dea-9a0429a80916 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] [instance: 57c03d68-3927-4635-9ba1-7daeae99793f] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:00:22.382942 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-fbc2db63-8a7a-4f2b-9dea-9a0429a80916 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:22.383389 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-fbc2db63-8a7a-4f2b-9dea-9a0429a80916 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:22.384155 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-fbc2db63-8a7a-4f2b-9dea-9a0429a80916 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:22.385232 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-fbc2db63-8a7a-4f2b-9dea-9a0429a80916 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:22.508710 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-fbc2db63-8a7a-4f2b-9dea-9a0429a80916 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd371b9690a4fe192c4cdf0b4d9900b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5e22820a1410d94c298e75220eb68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:00:22.516541 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-fbc2db63-8a7a-4f2b-9dea-9a0429a80916 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] 10.222.0.35 "GET /compute/v2.1/servers/57c03d68-3927-4635-9ba1-7daeae99793f" status: 200 len: 1506 microversion: 2.1 time: 0.144274 Aug 07 05:00:22.517130 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 433/907] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:00:22 2021] GET /compute/v2.1/servers/57c03d68-3927-4635-9ba1-7daeae99793f => generated 1506 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:00:22.533166 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-a27bb211-f16b-47f4-bbc2-122a727ad85b tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c4d8529-5006-4254-bd6f-5af9569ca179", "device": "/dev/sdb"}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:00:22.534555 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-a27bb211-f16b-47f4-bbc2-122a727ad85b tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] [instance: 57c03d68-3927-4635-9ba1-7daeae99793f] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:00:22.540468 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a27bb211-f16b-47f4-bbc2-122a727ad85b tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:22.541235 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a27bb211-f16b-47f4-bbc2-122a727ad85b tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:22.542293 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a27bb211-f16b-47f4-bbc2-122a727ad85b tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:22.542884 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a27bb211-f16b-47f4-bbc2-122a727ad85b tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:22.694151 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-e14a56a2-f2b3-41b2-abaf-5d5b5d4af3f7 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:00:22.694700 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-e14a56a2-f2b3-41b2-abaf-5d5b5d4af3f7 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 9842981a-3233-41c1-a42b-442492d50f3a] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:00:22.701091 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e14a56a2-f2b3-41b2-abaf-5d5b5d4af3f7 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:22.701538 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e14a56a2-f2b3-41b2-abaf-5d5b5d4af3f7 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:22.702425 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e14a56a2-f2b3-41b2-abaf-5d5b5d4af3f7 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:22.702861 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e14a56a2-f2b3-41b2-abaf-5d5b5d4af3f7 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:22.825932 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-a27bb211-f16b-47f4-bbc2-122a727ad85b tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] 10.222.0.35 "POST /compute/v2.1/servers/57c03d68-3927-4635-9ba1-7daeae99793f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296451 Aug 07 05:00:22.826849 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 475/908] 10.222.0.35 () {60 vars in 1323 bytes} [Sat Aug 7 05:00:22 2021] POST /compute/v2.1/servers/57c03d68-3927-4635-9ba1-7daeae99793f/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 05:00:22.837184 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-e14a56a2-f2b3-41b2-abaf-5d5b5d4af3f7 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:00:22.845162 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-e14a56a2-f2b3-41b2-abaf-5d5b5d4af3f7 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a" status: 200 len: 1576 microversion: 2.1 time: 0.155102 Aug 07 05:00:22.845735 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 434/909] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:00:22 2021] GET /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:00:23.863402 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-9e3475ef-77f3-407b-b0c0-f0dd88b2e552 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:00:23.864133 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-9e3475ef-77f3-407b-b0c0-f0dd88b2e552 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 9842981a-3233-41c1-a42b-442492d50f3a] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:00:23.871561 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9e3475ef-77f3-407b-b0c0-f0dd88b2e552 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:23.872002 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9e3475ef-77f3-407b-b0c0-f0dd88b2e552 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:23.872766 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9e3475ef-77f3-407b-b0c0-f0dd88b2e552 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:23.873217 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9e3475ef-77f3-407b-b0c0-f0dd88b2e552 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:23.999170 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-9e3475ef-77f3-407b-b0c0-f0dd88b2e552 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:00:24.006441 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-9e3475ef-77f3-407b-b0c0-f0dd88b2e552 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a" status: 200 len: 1576 microversion: 2.1 time: 0.147789 Aug 07 05:00:24.006998 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 476/910] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:00:23 2021] GET /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a => generated 1576 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:00:24.554684 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [req-1b409afa-f082-4e32-92a2-6b3396441d83 req-fd254077-5a09-4528-8e8a-f93384063b4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9842981a-3233-41c1-a42b-442492d50f3a", "name": "network-vif-deleted", "tag": "8625acb3-8bac-4659-9273-7a1a3bc30dc6"}]} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:00:24.557096 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 05:00:24.557096 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: warnings.warn(msg) Aug 07 05:00:24.564847 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-1b409afa-f082-4e32-92a2-6b3396441d83 req-fd254077-5a09-4528-8e8a-f93384063b4b service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:24.565276 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-1b409afa-f082-4e32-92a2-6b3396441d83 req-fd254077-5a09-4528-8e8a-f93384063b4b service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:24.578480 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.compute.server_external_events [req-1b409afa-f082-4e32-92a2-6b3396441d83 req-fd254077-5a09-4528-8e8a-f93384063b4b service nova] Creating event network-vif-deleted:8625acb3-8bac-4659-9273-7a1a3bc30dc6 for instance 9842981a-3233-41c1-a42b-442492d50f3a on hv-cinder-80374 Aug 07 05:00:24.584673 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [req-1b409afa-f082-4e32-92a2-6b3396441d83 req-fd254077-5a09-4528-8e8a-f93384063b4b service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033510 Aug 07 05:00:24.586236 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 435/911] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 05:00:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 05:00:25.023483 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-e5655f7f-ba97-4baf-bb81-7487251d0a4d tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:00:25.024687 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-e5655f7f-ba97-4baf-bb81-7487251d0a4d tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 9842981a-3233-41c1-a42b-442492d50f3a] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:00:25.031456 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e5655f7f-ba97-4baf-bb81-7487251d0a4d tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:25.031904 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e5655f7f-ba97-4baf-bb81-7487251d0a4d tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:25.032676 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e5655f7f-ba97-4baf-bb81-7487251d0a4d tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:25.033137 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e5655f7f-ba97-4baf-bb81-7487251d0a4d tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:25.065119 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e5655f7f-ba97-4baf-bb81-7487251d0a4d tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:25.065583 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e5655f7f-ba97-4baf-bb81-7487251d0a4d tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:25.066021 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.objects.instance [None req-e5655f7f-ba97-4baf-bb81-7487251d0a4d tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lazy-loading 'fault' on Instance uuid 9842981a-3233-41c1-a42b-442492d50f3a {{(pid=107486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 05:00:25.106190 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-e5655f7f-ba97-4baf-bb81-7487251d0a4d tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:00:25.114009 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-e5655f7f-ba97-4baf-bb81-7487251d0a4d tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a" status: 200 len: 1230 microversion: 2.1 time: 0.094136 Aug 07 05:00:25.114727 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 477/912] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:00:25 2021] GET /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a => generated 1230 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:00:26.132204 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-1520656e-0ed9-4ba7-ac34-630b78eef1e2 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:00:26.132941 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-1520656e-0ed9-4ba7-ac34-630b78eef1e2 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 9842981a-3233-41c1-a42b-442492d50f3a] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:00:26.140826 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1520656e-0ed9-4ba7-ac34-630b78eef1e2 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:26.141366 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1520656e-0ed9-4ba7-ac34-630b78eef1e2 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:26.142132 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1520656e-0ed9-4ba7-ac34-630b78eef1e2 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:26.142561 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1520656e-0ed9-4ba7-ac34-630b78eef1e2 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:26.155567 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.wsgi [None req-1520656e-0ed9-4ba7-ac34-630b78eef1e2 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] HTTP exception thrown: Instance 9842981a-3233-41c1-a42b-442492d50f3a could not be found. Aug 07 05:00:26.156180 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-1520656e-0ed9-4ba7-ac34-630b78eef1e2 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Returning 404 to user: Instance 9842981a-3233-41c1-a42b-442492d50f3a could not be found. {{(pid=107485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 07 05:00:26.157177 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-1520656e-0ed9-4ba7-ac34-630b78eef1e2 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a" status: 404 len: 111 microversion: 2.1 time: 0.028984 Aug 07 05:00:26.157719 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 436/913] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:00:26 2021] GET /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 05:00:26.249782 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-5cb6463e-6442-45f3-ac7e-60ed5f71ffa1 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-695490317", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1125723205", "security_groups": [{"name": "tempest-secgroup-smoke-428334738"}], "block_device_mapping_v2": [{"uuid": "c286e5e7-2a31-4ff3-875e-19ecb44e9a5c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b97eba61-232f-41ac-a37d-dd36ec699f72"}]}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:00:26.352260 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.network.neutron [None req-5cb6463e-6442-45f3-ac7e-60ed5f71ffa1 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] validate_networks() for [('b97eba61-232f-41ac-a37d-dd36ec699f72', None, None, None)] {{(pid=107486) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 07 05:00:26.722273 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.virt.hardware [None req-5cb6463e-6442-45f3-ac7e-60ed5f71ffa1 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Flavor limits 0:0:0 {{(pid=107486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 05:00:26.722759 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.virt.hardware [None req-5cb6463e-6442-45f3-ac7e-60ed5f71ffa1 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Image limits 0:0:0 {{(pid=107486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 05:00:26.723297 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.virt.hardware [None req-5cb6463e-6442-45f3-ac7e-60ed5f71ffa1 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Flavor pref 0:0:0 {{(pid=107486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 05:00:26.723711 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.virt.hardware [None req-5cb6463e-6442-45f3-ac7e-60ed5f71ffa1 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Image pref 0:0:0 {{(pid=107486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 05:00:26.724115 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.virt.hardware [None req-5cb6463e-6442-45f3-ac7e-60ed5f71ffa1 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 05:00:26.733387 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5cb6463e-6442-45f3-ac7e-60ed5f71ffa1 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:26.733923 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5cb6463e-6442-45f3-ac7e-60ed5f71ffa1 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:26.734836 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5cb6463e-6442-45f3-ac7e-60ed5f71ffa1 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:26.735369 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5cb6463e-6442-45f3-ac7e-60ed5f71ffa1 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:26.752072 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.quota [None req-5cb6463e-6442-45f3-ac7e-60ed5f71ffa1 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Getting quotas for project e90cab30a20644dbabb505e1ada2dc3a. Resources: {'ram', 'cores', 'instances'} {{(pid=107486) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 07 05:00:26.755956 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.quota [None req-5cb6463e-6442-45f3-ac7e-60ed5f71ffa1 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Getting quotas for user 1c71b131fcdb495d829a615ebae65aaa and project e90cab30a20644dbabb505e1ada2dc3a. Resources: {'ram', 'cores', 'instances'} {{(pid=107486) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 07 05:00:26.814710 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-5cb6463e-6442-45f3-ac7e-60ed5f71ffa1 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Going to run 1 instances... {{(pid=107486) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 07 05:00:26.816849 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-5cb6463e-6442-45f3-ac7e-60ed5f71ffa1 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 38aca19c-e68f-4376-82c7-9ba0111c9e85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c286e5e7-2a31-4ff3-875e-19ecb44e9a5c',volume_size=None,volume_type=None)] {{(pid=107486) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 07 05:00:26.935681 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-5cb6463e-6442-45f3-ac7e-60ed5f71ffa1 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.689495 Aug 07 05:00:26.936511 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 478/914] 10.222.0.35 () {60 vars in 1147 bytes} [Sat Aug 7 05:00:26 2021] POST /compute/v2.1/servers => generated 405 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 05:00:26.946841 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-87bfdc9a-3967-488a-8366-aa27dcba73f6 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:00:26.947580 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-87bfdc9a-3967-488a-8366-aa27dcba73f6 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 38aca19c-e68f-4376-82c7-9ba0111c9e85] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:00:27.006410 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-87bfdc9a-3967-488a-8366-aa27dcba73f6 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:00:27.013758 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-87bfdc9a-3967-488a-8366-aa27dcba73f6 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/38aca19c-e68f-4376-82c7-9ba0111c9e85" status: 200 len: 1094 microversion: 2.1 time: 0.070758 Aug 07 05:00:27.014257 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 437/915] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:00:26 2021] GET /compute/v2.1/servers/38aca19c-e68f-4376-82c7-9ba0111c9e85 => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:00:28.034112 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-5439b447-91f5-4250-8a8b-439a12843f29 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:00:28.035539 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-5439b447-91f5-4250-8a8b-439a12843f29 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 38aca19c-e68f-4376-82c7-9ba0111c9e85] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:00:28.044934 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5439b447-91f5-4250-8a8b-439a12843f29 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:28.045413 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5439b447-91f5-4250-8a8b-439a12843f29 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:28.047445 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5439b447-91f5-4250-8a8b-439a12843f29 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:28.047884 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5439b447-91f5-4250-8a8b-439a12843f29 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:28.120686 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-5439b447-91f5-4250-8a8b-439a12843f29 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:00:28.129071 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-5439b447-91f5-4250-8a8b-439a12843f29 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/38aca19c-e68f-4376-82c7-9ba0111c9e85" status: 200 len: 1210 microversion: 2.1 time: 0.100302 Aug 07 05:00:28.129657 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 479/916] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:00:28 2021] GET /compute/v2.1/servers/38aca19c-e68f-4376-82c7-9ba0111c9e85 => generated 1210 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:00:29.147082 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-01b25e2e-d1ea-4188-8fff-062aff9dc9c4 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:00:29.147676 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-01b25e2e-d1ea-4188-8fff-062aff9dc9c4 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 38aca19c-e68f-4376-82c7-9ba0111c9e85] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:00:29.154468 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-01b25e2e-d1ea-4188-8fff-062aff9dc9c4 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:29.154931 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-01b25e2e-d1ea-4188-8fff-062aff9dc9c4 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:29.155699 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-01b25e2e-d1ea-4188-8fff-062aff9dc9c4 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:29.156136 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-01b25e2e-d1ea-4188-8fff-062aff9dc9c4 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:29.338793 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-01b25e2e-d1ea-4188-8fff-062aff9dc9c4 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:00:29.346218 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-01b25e2e-d1ea-4188-8fff-062aff9dc9c4 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/38aca19c-e68f-4376-82c7-9ba0111c9e85" status: 200 len: 1277 microversion: 2.1 time: 0.202782 Aug 07 05:00:29.346794 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 438/917] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:00:29 2021] GET /compute/v2.1/servers/38aca19c-e68f-4376-82c7-9ba0111c9e85 => generated 1277 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:00:29.591935 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [req-75360591-9724-4b4a-b6d9-03387cdb6ac0 req-005f5a42-3e7a-4d98-bf5d-7494bec8160d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38aca19c-e68f-4376-82c7-9ba0111c9e85", "tag": "b3097a41-98dc-40cd-8944-3542f3ba37cb"}]} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:00:29.594075 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 05:00:29.594075 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: warnings.warn(msg) Aug 07 05:00:29.604205 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-75360591-9724-4b4a-b6d9-03387cdb6ac0 req-005f5a42-3e7a-4d98-bf5d-7494bec8160d service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:29.604634 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-75360591-9724-4b4a-b6d9-03387cdb6ac0 req-005f5a42-3e7a-4d98-bf5d-7494bec8160d service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:29.620999 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.compute.server_external_events [req-75360591-9724-4b4a-b6d9-03387cdb6ac0 req-005f5a42-3e7a-4d98-bf5d-7494bec8160d service nova] Creating event network-changed:b3097a41-98dc-40cd-8944-3542f3ba37cb for instance 38aca19c-e68f-4376-82c7-9ba0111c9e85 on hv-cinder-80374 Aug 07 05:00:29.630841 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [req-75360591-9724-4b4a-b6d9-03387cdb6ac0 req-005f5a42-3e7a-4d98-bf5d-7494bec8160d service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041420 Aug 07 05:00:29.632040 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 480/918] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 05:00:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 05:00:30.366435 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-a6a94171-ac45-4e8b-a628-b653141f6edf tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:00:30.367653 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-a6a94171-ac45-4e8b-a628-b653141f6edf tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 38aca19c-e68f-4376-82c7-9ba0111c9e85] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:00:30.374726 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a6a94171-ac45-4e8b-a628-b653141f6edf tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:30.375272 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a6a94171-ac45-4e8b-a628-b653141f6edf tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:30.376244 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a6a94171-ac45-4e8b-a628-b653141f6edf tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:30.376822 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a6a94171-ac45-4e8b-a628-b653141f6edf tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:30.601664 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-a6a94171-ac45-4e8b-a628-b653141f6edf tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:00:30.609574 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-a6a94171-ac45-4e8b-a628-b653141f6edf tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/38aca19c-e68f-4376-82c7-9ba0111c9e85" status: 200 len: 1277 microversion: 2.1 time: 0.246822 Aug 07 05:00:30.610153 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 439/919] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:00:30 2021] GET /compute/v2.1/servers/38aca19c-e68f-4376-82c7-9ba0111c9e85 => generated 1277 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:00:31.627590 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-3ea4b214-01aa-455b-aaf4-30c4905d4f5f tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:00:31.628281 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-3ea4b214-01aa-455b-aaf4-30c4905d4f5f tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 38aca19c-e68f-4376-82c7-9ba0111c9e85] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:00:31.634470 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3ea4b214-01aa-455b-aaf4-30c4905d4f5f tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:31.634915 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3ea4b214-01aa-455b-aaf4-30c4905d4f5f tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:31.635678 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3ea4b214-01aa-455b-aaf4-30c4905d4f5f tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:31.636177 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3ea4b214-01aa-455b-aaf4-30c4905d4f5f tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:31.755659 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-3ea4b214-01aa-455b-aaf4-30c4905d4f5f tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:00:31.763074 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-3ea4b214-01aa-455b-aaf4-30c4905d4f5f tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/38aca19c-e68f-4376-82c7-9ba0111c9e85" status: 200 len: 1265 microversion: 2.1 time: 0.139899 Aug 07 05:00:31.763641 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 481/920] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:00:31 2021] GET /compute/v2.1/servers/38aca19c-e68f-4376-82c7-9ba0111c9e85 => generated 1265 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:00:32.779913 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-53e52dfb-b0bc-4e27-8ae0-0ac51c76bb6b tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:00:32.780524 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-53e52dfb-b0bc-4e27-8ae0-0ac51c76bb6b tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 38aca19c-e68f-4376-82c7-9ba0111c9e85] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:00:32.786390 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-53e52dfb-b0bc-4e27-8ae0-0ac51c76bb6b tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:32.786835 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-53e52dfb-b0bc-4e27-8ae0-0ac51c76bb6b tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:32.787595 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-53e52dfb-b0bc-4e27-8ae0-0ac51c76bb6b tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:32.788027 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-53e52dfb-b0bc-4e27-8ae0-0ac51c76bb6b tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:32.907490 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-53e52dfb-b0bc-4e27-8ae0-0ac51c76bb6b tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:00:32.914639 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-53e52dfb-b0bc-4e27-8ae0-0ac51c76bb6b tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/38aca19c-e68f-4376-82c7-9ba0111c9e85" status: 200 len: 1265 microversion: 2.1 time: 0.139385 Aug 07 05:00:32.915183 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 440/921] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:00:32 2021] GET /compute/v2.1/servers/38aca19c-e68f-4376-82c7-9ba0111c9e85 => generated 1265 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:00:33.931768 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-72ff1b7d-e6db-40a9-9c68-de651937e5bb tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:00:33.932382 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-72ff1b7d-e6db-40a9-9c68-de651937e5bb tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 38aca19c-e68f-4376-82c7-9ba0111c9e85] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:00:33.939176 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-72ff1b7d-e6db-40a9-9c68-de651937e5bb tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:33.939622 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-72ff1b7d-e6db-40a9-9c68-de651937e5bb tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:33.940413 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-72ff1b7d-e6db-40a9-9c68-de651937e5bb tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:33.940868 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-72ff1b7d-e6db-40a9-9c68-de651937e5bb tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:34.063110 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-72ff1b7d-e6db-40a9-9c68-de651937e5bb tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:00:34.070222 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-72ff1b7d-e6db-40a9-9c68-de651937e5bb tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/38aca19c-e68f-4376-82c7-9ba0111c9e85" status: 200 len: 1265 microversion: 2.1 time: 0.142191 Aug 07 05:00:34.070783 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 482/922] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:00:33 2021] GET /compute/v2.1/servers/38aca19c-e68f-4376-82c7-9ba0111c9e85 => generated 1265 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:00:35.087025 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-ac769e8e-3fa3-4e1b-a63e-43bec18dad4d tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:00:35.087660 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-ac769e8e-3fa3-4e1b-a63e-43bec18dad4d tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 38aca19c-e68f-4376-82c7-9ba0111c9e85] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:00:35.094294 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ac769e8e-3fa3-4e1b-a63e-43bec18dad4d tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:35.094736 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ac769e8e-3fa3-4e1b-a63e-43bec18dad4d tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:35.095501 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ac769e8e-3fa3-4e1b-a63e-43bec18dad4d tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:35.095931 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ac769e8e-3fa3-4e1b-a63e-43bec18dad4d tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:35.218283 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-ac769e8e-3fa3-4e1b-a63e-43bec18dad4d tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:00:35.225433 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-ac769e8e-3fa3-4e1b-a63e-43bec18dad4d tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/38aca19c-e68f-4376-82c7-9ba0111c9e85" status: 200 len: 1265 microversion: 2.1 time: 0.142316 Aug 07 05:00:35.225991 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 441/923] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:00:35 2021] GET /compute/v2.1/servers/38aca19c-e68f-4376-82c7-9ba0111c9e85 => generated 1265 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:00:36.241539 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-de483061-dbcd-41d3-b295-5d09763aae0f tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:00:36.242144 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-de483061-dbcd-41d3-b295-5d09763aae0f tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 38aca19c-e68f-4376-82c7-9ba0111c9e85] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:00:36.248072 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-de483061-dbcd-41d3-b295-5d09763aae0f tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:36.248512 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-de483061-dbcd-41d3-b295-5d09763aae0f tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:36.249296 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-de483061-dbcd-41d3-b295-5d09763aae0f tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:36.249723 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-de483061-dbcd-41d3-b295-5d09763aae0f tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:36.367781 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-de483061-dbcd-41d3-b295-5d09763aae0f tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:00:36.375234 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-de483061-dbcd-41d3-b295-5d09763aae0f tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/38aca19c-e68f-4376-82c7-9ba0111c9e85" status: 200 len: 1265 microversion: 2.1 time: 0.137321 Aug 07 05:00:36.375805 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 483/924] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:00:36 2021] GET /compute/v2.1/servers/38aca19c-e68f-4376-82c7-9ba0111c9e85 => generated 1265 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:00:37.393393 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-c3abfd8e-b199-46f0-ba5c-ba97d27224af tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:00:37.394035 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-c3abfd8e-b199-46f0-ba5c-ba97d27224af tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 38aca19c-e68f-4376-82c7-9ba0111c9e85] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:00:37.400121 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c3abfd8e-b199-46f0-ba5c-ba97d27224af tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:37.400568 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c3abfd8e-b199-46f0-ba5c-ba97d27224af tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:37.402045 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c3abfd8e-b199-46f0-ba5c-ba97d27224af tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:37.402490 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c3abfd8e-b199-46f0-ba5c-ba97d27224af tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:37.520365 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-c3abfd8e-b199-46f0-ba5c-ba97d27224af tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:00:37.529558 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-c3abfd8e-b199-46f0-ba5c-ba97d27224af tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/38aca19c-e68f-4376-82c7-9ba0111c9e85" status: 200 len: 1265 microversion: 2.1 time: 0.141349 Aug 07 05:00:37.530124 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 442/925] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:00:37 2021] GET /compute/v2.1/servers/38aca19c-e68f-4376-82c7-9ba0111c9e85 => generated 1265 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:00:38.546368 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-b716de5c-3aaf-4c7e-a4b1-940ce45fce29 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:00:38.546968 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-b716de5c-3aaf-4c7e-a4b1-940ce45fce29 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 38aca19c-e68f-4376-82c7-9ba0111c9e85] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:00:38.552843 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b716de5c-3aaf-4c7e-a4b1-940ce45fce29 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:38.553285 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b716de5c-3aaf-4c7e-a4b1-940ce45fce29 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:38.554040 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b716de5c-3aaf-4c7e-a4b1-940ce45fce29 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:38.554469 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b716de5c-3aaf-4c7e-a4b1-940ce45fce29 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:38.671603 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-b716de5c-3aaf-4c7e-a4b1-940ce45fce29 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:00:38.678828 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-b716de5c-3aaf-4c7e-a4b1-940ce45fce29 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/38aca19c-e68f-4376-82c7-9ba0111c9e85" status: 200 len: 1265 microversion: 2.1 time: 0.136395 Aug 07 05:00:38.679384 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 484/926] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:00:38 2021] GET /compute/v2.1/servers/38aca19c-e68f-4376-82c7-9ba0111c9e85 => generated 1265 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:00:39.696037 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-eecf32a8-081e-4354-81ae-c35ddaaba41c tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:00:39.696640 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-eecf32a8-081e-4354-81ae-c35ddaaba41c tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 38aca19c-e68f-4376-82c7-9ba0111c9e85] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:00:39.703373 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-eecf32a8-081e-4354-81ae-c35ddaaba41c tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:39.703818 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-eecf32a8-081e-4354-81ae-c35ddaaba41c tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:39.704584 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-eecf32a8-081e-4354-81ae-c35ddaaba41c tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:39.705050 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-eecf32a8-081e-4354-81ae-c35ddaaba41c tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:39.822693 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-eecf32a8-081e-4354-81ae-c35ddaaba41c tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:00:39.830293 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-eecf32a8-081e-4354-81ae-c35ddaaba41c tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/38aca19c-e68f-4376-82c7-9ba0111c9e85" status: 200 len: 1265 microversion: 2.1 time: 0.137990 Aug 07 05:00:39.830848 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 443/927] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:00:39 2021] GET /compute/v2.1/servers/38aca19c-e68f-4376-82c7-9ba0111c9e85 => generated 1265 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:00:40.847612 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-2c402e93-ac26-4775-9afb-ec189bb93ef1 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:00:40.848216 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-2c402e93-ac26-4775-9afb-ec189bb93ef1 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 38aca19c-e68f-4376-82c7-9ba0111c9e85] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:00:40.854518 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2c402e93-ac26-4775-9afb-ec189bb93ef1 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:40.854941 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2c402e93-ac26-4775-9afb-ec189bb93ef1 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:40.855702 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2c402e93-ac26-4775-9afb-ec189bb93ef1 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:40.856127 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2c402e93-ac26-4775-9afb-ec189bb93ef1 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:40.976096 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-2c402e93-ac26-4775-9afb-ec189bb93ef1 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:00:40.983387 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-2c402e93-ac26-4775-9afb-ec189bb93ef1 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/38aca19c-e68f-4376-82c7-9ba0111c9e85" status: 200 len: 1265 microversion: 2.1 time: 0.139400 Aug 07 05:00:40.983945 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 485/928] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:00:40 2021] GET /compute/v2.1/servers/38aca19c-e68f-4376-82c7-9ba0111c9e85 => generated 1265 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:00:42.000128 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-7bccfae9-c465-4c53-bd5f-661e1ee07ed0 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:00:42.000733 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-7bccfae9-c465-4c53-bd5f-661e1ee07ed0 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 38aca19c-e68f-4376-82c7-9ba0111c9e85] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:00:42.006536 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7bccfae9-c465-4c53-bd5f-661e1ee07ed0 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:42.006975 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7bccfae9-c465-4c53-bd5f-661e1ee07ed0 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:42.007723 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7bccfae9-c465-4c53-bd5f-661e1ee07ed0 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:42.008149 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7bccfae9-c465-4c53-bd5f-661e1ee07ed0 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:42.129742 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-7bccfae9-c465-4c53-bd5f-661e1ee07ed0 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:00:42.136941 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-7bccfae9-c465-4c53-bd5f-661e1ee07ed0 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/38aca19c-e68f-4376-82c7-9ba0111c9e85" status: 200 len: 1265 microversion: 2.1 time: 0.140370 Aug 07 05:00:42.137498 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 444/929] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:00:41 2021] GET /compute/v2.1/servers/38aca19c-e68f-4376-82c7-9ba0111c9e85 => generated 1265 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 05:00:43.155120 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-6d39bf67-02bc-464f-ae08-90c6a89d1604 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:00:43.155748 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-6d39bf67-02bc-464f-ae08-90c6a89d1604 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 38aca19c-e68f-4376-82c7-9ba0111c9e85] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:00:43.162057 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6d39bf67-02bc-464f-ae08-90c6a89d1604 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:43.162571 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6d39bf67-02bc-464f-ae08-90c6a89d1604 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:43.163523 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6d39bf67-02bc-464f-ae08-90c6a89d1604 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:43.164065 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6d39bf67-02bc-464f-ae08-90c6a89d1604 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:43.285051 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-6d39bf67-02bc-464f-ae08-90c6a89d1604 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:00:43.293109 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-6d39bf67-02bc-464f-ae08-90c6a89d1604 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/38aca19c-e68f-4376-82c7-9ba0111c9e85" status: 200 len: 1265 microversion: 2.1 time: 0.142301 Aug 07 05:00:43.293676 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 486/930] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:00:43 2021] GET /compute/v2.1/servers/38aca19c-e68f-4376-82c7-9ba0111c9e85 => generated 1265 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:00:44.309451 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-c1a79059-1712-4de6-8d61-71bb407ba0ff tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:00:44.309982 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-c1a79059-1712-4de6-8d61-71bb407ba0ff tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 38aca19c-e68f-4376-82c7-9ba0111c9e85] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:00:44.315734 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c1a79059-1712-4de6-8d61-71bb407ba0ff tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:44.316181 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c1a79059-1712-4de6-8d61-71bb407ba0ff tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:44.316977 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c1a79059-1712-4de6-8d61-71bb407ba0ff tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:44.317410 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c1a79059-1712-4de6-8d61-71bb407ba0ff tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:44.440874 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-c1a79059-1712-4de6-8d61-71bb407ba0ff tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:00:44.449546 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-c1a79059-1712-4de6-8d61-71bb407ba0ff tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/38aca19c-e68f-4376-82c7-9ba0111c9e85" status: 200 len: 1265 microversion: 2.1 time: 0.143835 Aug 07 05:00:44.450117 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 445/931] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:00:44 2021] GET /compute/v2.1/servers/38aca19c-e68f-4376-82c7-9ba0111c9e85 => generated 1265 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:00:45.466375 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-07fd618d-22fb-45a5-af4c-cd2046e76f37 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:00:45.467007 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-07fd618d-22fb-45a5-af4c-cd2046e76f37 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 38aca19c-e68f-4376-82c7-9ba0111c9e85] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:00:45.473002 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-07fd618d-22fb-45a5-af4c-cd2046e76f37 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:45.473446 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-07fd618d-22fb-45a5-af4c-cd2046e76f37 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:45.474215 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-07fd618d-22fb-45a5-af4c-cd2046e76f37 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:45.474650 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-07fd618d-22fb-45a5-af4c-cd2046e76f37 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:45.590873 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-07fd618d-22fb-45a5-af4c-cd2046e76f37 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:00:45.598051 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-07fd618d-22fb-45a5-af4c-cd2046e76f37 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/38aca19c-e68f-4376-82c7-9ba0111c9e85" status: 200 len: 1265 microversion: 2.1 time: 0.135353 Aug 07 05:00:45.598626 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 487/932] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:00:45 2021] GET /compute/v2.1/servers/38aca19c-e68f-4376-82c7-9ba0111c9e85 => generated 1265 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:00:46.186121 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-527da6a8-a252-4b0b-9ced-c2622aab2dc6 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:00:46.186635 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-527da6a8-a252-4b0b-9ced-c2622aab2dc6 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] [instance: 57c03d68-3927-4635-9ba1-7daeae99793f] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:00:46.192377 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-527da6a8-a252-4b0b-9ced-c2622aab2dc6 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:46.192844 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-527da6a8-a252-4b0b-9ced-c2622aab2dc6 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:46.193608 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-527da6a8-a252-4b0b-9ced-c2622aab2dc6 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:46.194035 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-527da6a8-a252-4b0b-9ced-c2622aab2dc6 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:46.275412 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.objects.instance [None req-527da6a8-a252-4b0b-9ced-c2622aab2dc6 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lazy-loading 'services' on Instance uuid 57c03d68-3927-4635-9ba1-7daeae99793f {{(pid=107485) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 05:00:46.340260 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-527da6a8-a252-4b0b-9ced-c2622aab2dc6 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] 10.222.0.35 "DELETE /compute/v2.1/servers/57c03d68-3927-4635-9ba1-7daeae99793f/os-volume_attachments/9c4d8529-5006-4254-bd6f-5af9569ca179" status: 202 len: 0 microversion: 2.1 time: 0.157783 Aug 07 05:00:46.340854 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 446/933] 10.222.0.35 () {58 vars in 1416 bytes} [Sat Aug 7 05:00:46 2021] DELETE /compute/v2.1/servers/57c03d68-3927-4635-9ba1-7daeae99793f/os-volume_attachments/9c4d8529-5006-4254-bd6f-5af9569ca179 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:00:46.615860 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-2186b04e-f653-4cdc-b21b-02d4b34f9104 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:00:46.616251 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-2186b04e-f653-4cdc-b21b-02d4b34f9104 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 38aca19c-e68f-4376-82c7-9ba0111c9e85] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:00:46.622098 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2186b04e-f653-4cdc-b21b-02d4b34f9104 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:46.622548 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2186b04e-f653-4cdc-b21b-02d4b34f9104 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:46.623321 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2186b04e-f653-4cdc-b21b-02d4b34f9104 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:46.623756 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2186b04e-f653-4cdc-b21b-02d4b34f9104 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:46.743701 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-2186b04e-f653-4cdc-b21b-02d4b34f9104 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:00:46.751436 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-2186b04e-f653-4cdc-b21b-02d4b34f9104 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/38aca19c-e68f-4376-82c7-9ba0111c9e85" status: 200 len: 1265 microversion: 2.1 time: 0.139750 Aug 07 05:00:46.751995 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 488/934] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:00:46 2021] GET /compute/v2.1/servers/38aca19c-e68f-4376-82c7-9ba0111c9e85 => generated 1265 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:00:47.362027 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [req-ab557ace-6f60-4233-bfa3-3c8996034098 req-e5cc49b7-cdd0-4bf5-98ea-3fae0f5649df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38aca19c-e68f-4376-82c7-9ba0111c9e85", "name": "network-vif-plugged", "status": "completed", "tag": "b3097a41-98dc-40cd-8944-3542f3ba37cb"}]} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:00:47.363662 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 05:00:47.363662 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: warnings.warn(msg) Aug 07 05:00:47.378590 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-ab557ace-6f60-4233-bfa3-3c8996034098 req-e5cc49b7-cdd0-4bf5-98ea-3fae0f5649df service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:47.379027 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-ab557ace-6f60-4233-bfa3-3c8996034098 req-e5cc49b7-cdd0-4bf5-98ea-3fae0f5649df service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:47.390234 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.compute.server_external_events [req-ab557ace-6f60-4233-bfa3-3c8996034098 req-e5cc49b7-cdd0-4bf5-98ea-3fae0f5649df service nova] Creating event network-vif-plugged:b3097a41-98dc-40cd-8944-3542f3ba37cb for instance 38aca19c-e68f-4376-82c7-9ba0111c9e85 on hv-cinder-80374 Aug 07 05:00:47.395668 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [req-ab557ace-6f60-4233-bfa3-3c8996034098 req-e5cc49b7-cdd0-4bf5-98ea-3fae0f5649df service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038261 Aug 07 05:00:47.395800 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 447/935] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 05:00:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 05:00:47.461684 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-61558de4-46d0-4a2a-b79d-03d6a25cb7a8 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:00:47.462169 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-61558de4-46d0-4a2a-b79d-03d6a25cb7a8 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] [instance: 57c03d68-3927-4635-9ba1-7daeae99793f] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:00:47.468646 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-61558de4-46d0-4a2a-b79d-03d6a25cb7a8 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:47.469249 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-61558de4-46d0-4a2a-b79d-03d6a25cb7a8 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:47.470051 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-61558de4-46d0-4a2a-b79d-03d6a25cb7a8 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:47.470485 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-61558de4-46d0-4a2a-b79d-03d6a25cb7a8 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:47.495813 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-61558de4-46d0-4a2a-b79d-03d6a25cb7a8 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] [instance: 57c03d68-3927-4635-9ba1-7daeae99793f] Going to try to terminate instance {{(pid=107486) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 07 05:00:47.569216 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-61558de4-46d0-4a2a-b79d-03d6a25cb7a8 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] 10.222.0.35 "DELETE /compute/v2.1/servers/57c03d68-3927-4635-9ba1-7daeae99793f" status: 204 len: 0 microversion: 2.1 time: 0.111341 Aug 07 05:00:47.569807 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 489/936] 10.222.0.35 () {58 vars in 1239 bytes} [Sat Aug 7 05:00:47 2021] DELETE /compute/v2.1/servers/57c03d68-3927-4635-9ba1-7daeae99793f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 05:00:47.578507 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-c51e110d-67d9-4758-8ae1-cddf5423fb98 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:00:47.579300 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-c51e110d-67d9-4758-8ae1-cddf5423fb98 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] [instance: 57c03d68-3927-4635-9ba1-7daeae99793f] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:00:47.585590 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c51e110d-67d9-4758-8ae1-cddf5423fb98 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:47.586037 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c51e110d-67d9-4758-8ae1-cddf5423fb98 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:47.586802 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c51e110d-67d9-4758-8ae1-cddf5423fb98 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:47.587231 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c51e110d-67d9-4758-8ae1-cddf5423fb98 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:47.734350 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-c51e110d-67d9-4758-8ae1-cddf5423fb98 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd371b9690a4fe192c4cdf0b4d9900b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5e22820a1410d94c298e75220eb68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:00:47.741747 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-c51e110d-67d9-4758-8ae1-cddf5423fb98 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] 10.222.0.35 "GET /compute/v2.1/servers/57c03d68-3927-4635-9ba1-7daeae99793f" status: 200 len: 1512 microversion: 2.1 time: 0.167446 Aug 07 05:00:47.742309 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 448/937] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:00:47 2021] GET /compute/v2.1/servers/57c03d68-3927-4635-9ba1-7daeae99793f => generated 1512 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 05:00:47.769137 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-c7750425-8930-4d9a-b997-b00b21a19be4 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:00:47.769958 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-c7750425-8930-4d9a-b997-b00b21a19be4 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 38aca19c-e68f-4376-82c7-9ba0111c9e85] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:00:47.776047 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c7750425-8930-4d9a-b997-b00b21a19be4 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:47.776494 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c7750425-8930-4d9a-b997-b00b21a19be4 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:47.777291 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c7750425-8930-4d9a-b997-b00b21a19be4 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:47.777750 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c7750425-8930-4d9a-b997-b00b21a19be4 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:47.896286 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-c7750425-8930-4d9a-b997-b00b21a19be4 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:00:47.903824 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-c7750425-8930-4d9a-b997-b00b21a19be4 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/38aca19c-e68f-4376-82c7-9ba0111c9e85" status: 200 len: 1265 microversion: 2.1 time: 0.138782 Aug 07 05:00:47.904392 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 490/938] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:00:47 2021] GET /compute/v2.1/servers/38aca19c-e68f-4376-82c7-9ba0111c9e85 => generated 1265 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:00:48.759181 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-25056c07-e2d5-448b-b89c-e84b93a1fa8c tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:00:48.759787 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-25056c07-e2d5-448b-b89c-e84b93a1fa8c tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] [instance: 57c03d68-3927-4635-9ba1-7daeae99793f] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:00:48.766707 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-25056c07-e2d5-448b-b89c-e84b93a1fa8c tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:48.767151 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-25056c07-e2d5-448b-b89c-e84b93a1fa8c tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:48.767913 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-25056c07-e2d5-448b-b89c-e84b93a1fa8c tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:48.768342 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-25056c07-e2d5-448b-b89c-e84b93a1fa8c tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:48.888519 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-25056c07-e2d5-448b-b89c-e84b93a1fa8c tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd371b9690a4fe192c4cdf0b4d9900b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5e22820a1410d94c298e75220eb68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:00:48.895828 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-25056c07-e2d5-448b-b89c-e84b93a1fa8c tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] 10.222.0.35 "GET /compute/v2.1/servers/57c03d68-3927-4635-9ba1-7daeae99793f" status: 200 len: 1512 microversion: 2.1 time: 0.140395 Aug 07 05:00:48.896382 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 449/939] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:00:48 2021] GET /compute/v2.1/servers/57c03d68-3927-4635-9ba1-7daeae99793f => generated 1512 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:00:48.920066 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-16a440f8-6688-47d7-87b4-902927a03fe2 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:00:48.920672 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-16a440f8-6688-47d7-87b4-902927a03fe2 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 38aca19c-e68f-4376-82c7-9ba0111c9e85] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:00:48.926540 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-16a440f8-6688-47d7-87b4-902927a03fe2 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:48.926965 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-16a440f8-6688-47d7-87b4-902927a03fe2 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:48.927728 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-16a440f8-6688-47d7-87b4-902927a03fe2 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:48.928156 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-16a440f8-6688-47d7-87b4-902927a03fe2 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:49.045112 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-16a440f8-6688-47d7-87b4-902927a03fe2 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:00:49.052349 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-16a440f8-6688-47d7-87b4-902927a03fe2 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/38aca19c-e68f-4376-82c7-9ba0111c9e85" status: 200 len: 1265 microversion: 2.1 time: 0.135925 Aug 07 05:00:49.052935 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 491/940] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:00:48 2021] GET /compute/v2.1/servers/38aca19c-e68f-4376-82c7-9ba0111c9e85 => generated 1265 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:00:49.913346 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-0a84d292-e0ce-45e1-8976-dce2d4091678 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:00:49.913902 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-0a84d292-e0ce-45e1-8976-dce2d4091678 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] [instance: 57c03d68-3927-4635-9ba1-7daeae99793f] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:00:49.920145 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0a84d292-e0ce-45e1-8976-dce2d4091678 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:49.920584 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0a84d292-e0ce-45e1-8976-dce2d4091678 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:49.921368 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0a84d292-e0ce-45e1-8976-dce2d4091678 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:49.921796 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0a84d292-e0ce-45e1-8976-dce2d4091678 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:50.039263 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-0a84d292-e0ce-45e1-8976-dce2d4091678 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd371b9690a4fe192c4cdf0b4d9900b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5e22820a1410d94c298e75220eb68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:00:50.046999 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-0a84d292-e0ce-45e1-8976-dce2d4091678 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] 10.222.0.35 "GET /compute/v2.1/servers/57c03d68-3927-4635-9ba1-7daeae99793f" status: 200 len: 1512 microversion: 2.1 time: 0.137383 Aug 07 05:00:50.047549 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 450/941] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:00:49 2021] GET /compute/v2.1/servers/57c03d68-3927-4635-9ba1-7daeae99793f => generated 1512 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:00:50.068571 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-b3424141-95a7-4771-87a7-0b001760d970 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:00:50.069209 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-b3424141-95a7-4771-87a7-0b001760d970 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 38aca19c-e68f-4376-82c7-9ba0111c9e85] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:00:50.075842 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b3424141-95a7-4771-87a7-0b001760d970 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:50.076294 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b3424141-95a7-4771-87a7-0b001760d970 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:50.077097 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b3424141-95a7-4771-87a7-0b001760d970 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:50.077540 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b3424141-95a7-4771-87a7-0b001760d970 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:50.204310 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-b3424141-95a7-4771-87a7-0b001760d970 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:00:50.211812 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-b3424141-95a7-4771-87a7-0b001760d970 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/38aca19c-e68f-4376-82c7-9ba0111c9e85" status: 200 len: 1453 microversion: 2.1 time: 0.146887 Aug 07 05:00:50.212370 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 492/942] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:00:50 2021] GET /compute/v2.1/servers/38aca19c-e68f-4376-82c7-9ba0111c9e85 => generated 1453 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:00:50.227703 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-a170238c-9e19-428c-9051-ed8e3958f887 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:00:50.228311 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-a170238c-9e19-428c-9051-ed8e3958f887 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 38aca19c-e68f-4376-82c7-9ba0111c9e85] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:00:50.234248 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a170238c-9e19-428c-9051-ed8e3958f887 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:50.234692 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a170238c-9e19-428c-9051-ed8e3958f887 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:50.235455 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a170238c-9e19-428c-9051-ed8e3958f887 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:50.235887 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a170238c-9e19-428c-9051-ed8e3958f887 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:50.358377 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-a170238c-9e19-428c-9051-ed8e3958f887 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:00:50.365591 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-a170238c-9e19-428c-9051-ed8e3958f887 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/38aca19c-e68f-4376-82c7-9ba0111c9e85" status: 200 len: 1453 microversion: 2.1 time: 0.141470 Aug 07 05:00:50.366149 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 451/943] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:00:50 2021] GET /compute/v2.1/servers/38aca19c-e68f-4376-82c7-9ba0111c9e85 => generated 1453 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:00:51.063321 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-d826e7b6-a6cc-4fe8-9f91-bbd7ec4ef019 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:00:51.064048 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-d826e7b6-a6cc-4fe8-9f91-bbd7ec4ef019 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] [instance: 57c03d68-3927-4635-9ba1-7daeae99793f] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:00:51.070582 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d826e7b6-a6cc-4fe8-9f91-bbd7ec4ef019 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:51.070582 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d826e7b6-a6cc-4fe8-9f91-bbd7ec4ef019 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:51.071289 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d826e7b6-a6cc-4fe8-9f91-bbd7ec4ef019 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:51.071821 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d826e7b6-a6cc-4fe8-9f91-bbd7ec4ef019 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:51.133590 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-d826e7b6-a6cc-4fe8-9f91-bbd7ec4ef019 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd371b9690a4fe192c4cdf0b4d9900b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5e22820a1410d94c298e75220eb68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:00:51.141679 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-d826e7b6-a6cc-4fe8-9f91-bbd7ec4ef019 tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] 10.222.0.35 "GET /compute/v2.1/servers/57c03d68-3927-4635-9ba1-7daeae99793f" status: 200 len: 1470 microversion: 2.1 time: 0.081963 Aug 07 05:00:51.142298 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 493/944] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:00:51 2021] GET /compute/v2.1/servers/57c03d68-3927-4635-9ba1-7daeae99793f => generated 1470 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:00:51.225834 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [req-29b20062-e3c2-44b4-b465-b482fa475071 req-37e049fe-c8f9-48f3-a3b2-a03032b9f26c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57c03d68-3927-4635-9ba1-7daeae99793f", "name": "network-vif-deleted", "tag": "cf47d2d3-865a-452e-a12f-2fb0e2eae36b"}]} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:00:51.227417 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 05:00:51.227417 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: warnings.warn(msg) Aug 07 05:00:51.234449 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-29b20062-e3c2-44b4-b465-b482fa475071 req-37e049fe-c8f9-48f3-a3b2-a03032b9f26c service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:51.234929 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-29b20062-e3c2-44b4-b465-b482fa475071 req-37e049fe-c8f9-48f3-a3b2-a03032b9f26c service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:51.247115 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.compute.server_external_events [req-29b20062-e3c2-44b4-b465-b482fa475071 req-37e049fe-c8f9-48f3-a3b2-a03032b9f26c service nova] Creating event network-vif-deleted:cf47d2d3-865a-452e-a12f-2fb0e2eae36b for instance 57c03d68-3927-4635-9ba1-7daeae99793f on hv-cinder-80374 Aug 07 05:00:51.256532 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [req-29b20062-e3c2-44b4-b465-b482fa475071 req-37e049fe-c8f9-48f3-a3b2-a03032b9f26c service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034331 Aug 07 05:00:51.257168 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 452/945] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 05:00:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 05:00:52.159340 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-694e081e-88d3-4a02-85ea-1b30b0fd4abb tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:00:52.159902 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-694e081e-88d3-4a02-85ea-1b30b0fd4abb tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] [instance: 57c03d68-3927-4635-9ba1-7daeae99793f] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:00:52.166835 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-694e081e-88d3-4a02-85ea-1b30b0fd4abb tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:52.167471 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-694e081e-88d3-4a02-85ea-1b30b0fd4abb tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:52.168268 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-694e081e-88d3-4a02-85ea-1b30b0fd4abb tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:52.168704 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-694e081e-88d3-4a02-85ea-1b30b0fd4abb tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:52.183552 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.wsgi [None req-694e081e-88d3-4a02-85ea-1b30b0fd4abb tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] HTTP exception thrown: Instance 57c03d68-3927-4635-9ba1-7daeae99793f could not be found. Aug 07 05:00:52.184159 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-694e081e-88d3-4a02-85ea-1b30b0fd4abb tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] Returning 404 to user: Instance 57c03d68-3927-4635-9ba1-7daeae99793f could not be found. {{(pid=107486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 07 05:00:52.185052 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-694e081e-88d3-4a02-85ea-1b30b0fd4abb tempest-VolumesSnapshotTestJSON-34432739 tempest-VolumesSnapshotTestJSON-34432739-project] 10.222.0.35 "GET /compute/v2.1/servers/57c03d68-3927-4635-9ba1-7daeae99793f" status: 404 len: 111 microversion: 2.1 time: 0.029498 Aug 07 05:00:52.185620 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 494/946] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:00:52 2021] GET /compute/v2.1/servers/57c03d68-3927-4635-9ba1-7daeae99793f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 05:00:53.280700 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [req-8850ed3d-8eb9-4597-9f56-fee3afaa7cc9 req-9a662d0e-cccc-49a8-85be-75c3757a7bcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38aca19c-e68f-4376-82c7-9ba0111c9e85", "tag": "b3097a41-98dc-40cd-8944-3542f3ba37cb"}]} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:00:53.282180 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 05:00:53.282180 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: warnings.warn(msg) Aug 07 05:00:53.289186 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-8850ed3d-8eb9-4597-9f56-fee3afaa7cc9 req-9a662d0e-cccc-49a8-85be-75c3757a7bcc service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:00:53.289637 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-8850ed3d-8eb9-4597-9f56-fee3afaa7cc9 req-9a662d0e-cccc-49a8-85be-75c3757a7bcc service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:00:53.300917 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.compute.server_external_events [req-8850ed3d-8eb9-4597-9f56-fee3afaa7cc9 req-9a662d0e-cccc-49a8-85be-75c3757a7bcc service nova] Creating event network-changed:b3097a41-98dc-40cd-8944-3542f3ba37cb for instance 38aca19c-e68f-4376-82c7-9ba0111c9e85 on hv-cinder-80374 Aug 07 05:00:53.305715 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [req-8850ed3d-8eb9-4597-9f56-fee3afaa7cc9 req-9a662d0e-cccc-49a8-85be-75c3757a7bcc service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029145 Aug 07 05:00:53.306314 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 453/947] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 05:00:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 05:01:11.280199 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-6ab3a67c-4b5d-4f4c-9a8c-ccfe730e7f07 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:01:11.280833 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-6ab3a67c-4b5d-4f4c-9a8c-ccfe730e7f07 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:01:11.286799 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6ab3a67c-4b5d-4f4c-9a8c-ccfe730e7f07 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:11.287240 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6ab3a67c-4b5d-4f4c-9a8c-ccfe730e7f07 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:11.287996 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6ab3a67c-4b5d-4f4c-9a8c-ccfe730e7f07 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:11.288424 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6ab3a67c-4b5d-4f4c-9a8c-ccfe730e7f07 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:11.317181 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-6ab3a67c-4b5d-4f4c-9a8c-ccfe730e7f07 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/os-volume_attachments/b5170073-832e-4aa0-af20-6257db8a054e" status: 200 len: 194 microversion: 2.20 time: 0.040809 Aug 07 05:01:11.317747 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 495/948] 10.222.0.35 () {60 vars in 1454 bytes} [Sat Aug 7 05:01:11 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/os-volume_attachments/b5170073-832e-4aa0-af20-6257db8a054e => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:01:11.389235 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-ac102867-1fc2-4186-9c52-24415a3287e4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:01:11.389804 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-ac102867-1fc2-4186-9c52-24415a3287e4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:01:11.395861 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ac102867-1fc2-4186-9c52-24415a3287e4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:11.396300 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ac102867-1fc2-4186-9c52-24415a3287e4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:11.397080 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ac102867-1fc2-4186-9c52-24415a3287e4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:11.397510 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ac102867-1fc2-4186-9c52-24415a3287e4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:11.480283 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.objects.instance [None req-ac102867-1fc2-4186-9c52-24415a3287e4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lazy-loading 'services' on Instance uuid 431857b6-a453-44f0-829c-00ed610d5fc2 {{(pid=107485) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 05:01:11.540718 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-ac102867-1fc2-4186-9c52-24415a3287e4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "DELETE /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/os-volume_attachments/b5170073-832e-4aa0-af20-6257db8a054e" status: 202 len: 0 microversion: 2.20 time: 0.155567 Aug 07 05:01:11.542466 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 454/949] 10.222.0.35 () {60 vars in 1457 bytes} [Sat Aug 7 05:01:11 2021] DELETE /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/os-volume_attachments/b5170073-832e-4aa0-af20-6257db8a054e => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 07 05:01:11.550375 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-4599ea93-1174-49a1-96ef-5fcdc29ea84a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:01:11.551291 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-4599ea93-1174-49a1-96ef-5fcdc29ea84a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:01:11.557555 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4599ea93-1174-49a1-96ef-5fcdc29ea84a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:11.558201 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4599ea93-1174-49a1-96ef-5fcdc29ea84a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:11.559033 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4599ea93-1174-49a1-96ef-5fcdc29ea84a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:11.559477 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4599ea93-1174-49a1-96ef-5fcdc29ea84a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:11.597365 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-4599ea93-1174-49a1-96ef-5fcdc29ea84a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050760 Aug 07 05:01:11.597921 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 496/950] 10.222.0.35 () {60 vars in 1343 bytes} [Sat Aug 7 05:01:11 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:01:12.173346 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 05:01:12.173596 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: Sat Aug 7 05:01:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 05:01:12.609720 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-374d4690-3b09-44d2-ac1f-b3732ca178f6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:01:12.610780 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-374d4690-3b09-44d2-ac1f-b3732ca178f6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:01:12.616862 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-374d4690-3b09-44d2-ac1f-b3732ca178f6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:12.617301 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-374d4690-3b09-44d2-ac1f-b3732ca178f6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:12.618064 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-374d4690-3b09-44d2-ac1f-b3732ca178f6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:12.618488 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-374d4690-3b09-44d2-ac1f-b3732ca178f6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:12.648060 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-374d4690-3b09-44d2-ac1f-b3732ca178f6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042660 Aug 07 05:01:12.648594 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 455/951] 10.222.0.35 () {60 vars in 1343 bytes} [Sat Aug 7 05:01:12 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:01:12.711204 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-fdd76ced-4dfa-4f0b-93a2-aa056390da5c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:01:12.711684 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-fdd76ced-4dfa-4f0b-93a2-aa056390da5c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:01:12.718118 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-fdd76ced-4dfa-4f0b-93a2-aa056390da5c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:12.718560 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-fdd76ced-4dfa-4f0b-93a2-aa056390da5c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:12.719362 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-fdd76ced-4dfa-4f0b-93a2-aa056390da5c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:12.719794 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-fdd76ced-4dfa-4f0b-93a2-aa056390da5c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:12.744290 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-fdd76ced-4dfa-4f0b-93a2-aa056390da5c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Going to try to terminate instance {{(pid=107486) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 07 05:01:12.822030 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-fdd76ced-4dfa-4f0b-93a2-aa056390da5c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "DELETE /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 204 len: 0 microversion: 2.20 time: 0.114591 Aug 07 05:01:12.823887 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 497/952] 10.222.0.35 () {60 vars in 1280 bytes} [Sat Aug 7 05:01:12 2021] DELETE /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 07 05:01:12.831863 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-d3268ac1-8e8a-4118-b52d-dea08664d965 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:01:12.832461 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-d3268ac1-8e8a-4118-b52d-dea08664d965 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:01:12.838452 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d3268ac1-8e8a-4118-b52d-dea08664d965 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:12.841209 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d3268ac1-8e8a-4118-b52d-dea08664d965 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:12.841992 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d3268ac1-8e8a-4118-b52d-dea08664d965 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:12.842423 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d3268ac1-8e8a-4118-b52d-dea08664d965 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:12.963863 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-d3268ac1-8e8a-4118-b52d-dea08664d965 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:01:12.971798 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-d3268ac1-8e8a-4118-b52d-dea08664d965 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:01:12.973308 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-d3268ac1-8e8a-4118-b52d-dea08664d965 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:01:12.974432 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-d3268ac1-8e8a-4118-b52d-dea08664d965 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1720 microversion: 2.20 time: 0.146447 Aug 07 05:01:12.974986 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 456/953] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:01:12 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1720 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 05:01:13.992436 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-84d8e3bc-d55a-45a5-bdea-b80b4192e36c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:01:13.993163 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-84d8e3bc-d55a-45a5-bdea-b80b4192e36c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:01:14.000140 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-84d8e3bc-d55a-45a5-bdea-b80b4192e36c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:14.000584 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-84d8e3bc-d55a-45a5-bdea-b80b4192e36c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:14.001384 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-84d8e3bc-d55a-45a5-bdea-b80b4192e36c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:14.001816 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-84d8e3bc-d55a-45a5-bdea-b80b4192e36c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:14.122415 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-84d8e3bc-d55a-45a5-bdea-b80b4192e36c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:01:14.130234 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-84d8e3bc-d55a-45a5-bdea-b80b4192e36c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:01:14.131712 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-84d8e3bc-d55a-45a5-bdea-b80b4192e36c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:01:14.132866 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-84d8e3bc-d55a-45a5-bdea-b80b4192e36c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1720 microversion: 2.20 time: 0.144505 Aug 07 05:01:14.133412 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 498/954] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:01:13 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1720 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 05:01:15.151739 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-c53d3493-8e2b-4655-9ca5-34063d5d75ea tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:01:15.153204 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-c53d3493-8e2b-4655-9ca5-34063d5d75ea tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:01:15.159587 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c53d3493-8e2b-4655-9ca5-34063d5d75ea tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:15.160041 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c53d3493-8e2b-4655-9ca5-34063d5d75ea tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:15.160852 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c53d3493-8e2b-4655-9ca5-34063d5d75ea tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:15.161289 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c53d3493-8e2b-4655-9ca5-34063d5d75ea tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:15.380902 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-c53d3493-8e2b-4655-9ca5-34063d5d75ea tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:01:15.389801 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-c53d3493-8e2b-4655-9ca5-34063d5d75ea tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:01:15.391293 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-c53d3493-8e2b-4655-9ca5-34063d5d75ea tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:01:15.392456 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-c53d3493-8e2b-4655-9ca5-34063d5d75ea tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 200 len: 1720 microversion: 2.20 time: 0.245176 Aug 07 05:01:15.392990 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 457/955] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:01:15 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 1720 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 05:01:15.768866 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [req-33796b9a-f326-4252-89ac-dffaf292737e req-349c9274-abca-43e4-a3f2-8c3200aa01a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "431857b6-a453-44f0-829c-00ed610d5fc2", "name": "network-vif-deleted", "tag": "6a0264c8-c45c-4fec-b570-31fbf0131107"}]} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:01:15.770413 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 05:01:15.770413 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: warnings.warn(msg) Aug 07 05:01:15.779087 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-33796b9a-f326-4252-89ac-dffaf292737e req-349c9274-abca-43e4-a3f2-8c3200aa01a7 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:15.779529 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-33796b9a-f326-4252-89ac-dffaf292737e req-349c9274-abca-43e4-a3f2-8c3200aa01a7 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:15.791279 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.compute.server_external_events [req-33796b9a-f326-4252-89ac-dffaf292737e req-349c9274-abca-43e4-a3f2-8c3200aa01a7 service nova] Creating event network-vif-deleted:6a0264c8-c45c-4fec-b570-31fbf0131107 for instance 431857b6-a453-44f0-829c-00ed610d5fc2 on hv-cinder-80374 Aug 07 05:01:15.797076 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [req-33796b9a-f326-4252-89ac-dffaf292737e req-349c9274-abca-43e4-a3f2-8c3200aa01a7 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032079 Aug 07 05:01:15.797638 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 499/956] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 05:01:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 05:01:16.411136 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-1f684efb-4057-47e9-a770-319d64d7c922 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:01:16.411764 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-1f684efb-4057-47e9-a770-319d64d7c922 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:01:16.418205 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1f684efb-4057-47e9-a770-319d64d7c922 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:16.418646 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1f684efb-4057-47e9-a770-319d64d7c922 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:16.419445 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1f684efb-4057-47e9-a770-319d64d7c922 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:16.419882 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1f684efb-4057-47e9-a770-319d64d7c922 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:16.433266 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.wsgi [None req-1f684efb-4057-47e9-a770-319d64d7c922 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] HTTP exception thrown: Instance 431857b6-a453-44f0-829c-00ed610d5fc2 could not be found. Aug 07 05:01:16.433854 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-1f684efb-4057-47e9-a770-319d64d7c922 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Returning 404 to user: Instance 431857b6-a453-44f0-829c-00ed610d5fc2 could not be found. {{(pid=107485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 07 05:01:16.434666 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-1f684efb-4057-47e9-a770-319d64d7c922 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 404 len: 111 microversion: 2.20 time: 0.027208 Aug 07 05:01:16.435194 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 458/957] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:01:16 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 07 05:01:16.444202 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-c191eae3-5325-4015-8217-ba03700bc083 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '.version_select at 0x7f75ebf985e0>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:01:16.448872 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c191eae3-5325-4015-8217-ba03700bc083 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [7fa2029d-6165-42be-8823-0e98100d3e8e] AMQP server on 10.222.0.35:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 07 05:01:17.470684 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO oslo.messaging._drivers.impl_rabbit [None req-c191eae3-5325-4015-8217-ba03700bc083 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [7fa2029d-6165-42be-8823-0e98100d3e8e] Reconnected to AMQP server on 10.222.0.35:5672 via [amqp] client with port 53818. Aug 07 05:01:17.490060 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-c191eae3-5325-4015-8217-ba03700bc083 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-755006623" status: 204 len: 0 microversion: 2.20 time: 1.049904 Aug 07 05:01:17.490854 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 500/958] 10.222.0.35 () {60 vars in 1259 bytes} [Sat Aug 7 05:01:16 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-755006623 => generated 0 bytes in 1051 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 07 05:01:18.458771 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-90a8ff69-76a5-4093-9fcc-7d6107b52253 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'create', calling method: .version_select at 0x7f75f815c940>, body: {"keypair": {"name": "tempest-keypair-449470537"}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:01:18.475703 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.quota [None req-90a8ff69-76a5-4093-9fcc-7d6107b52253 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Getting quotas for project 6c23fa4998bf4a8cb6fa05e019c813bd. Resources: {'key_pairs'} {{(pid=107485) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 07 05:01:18.479654 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.quota [None req-90a8ff69-76a5-4093-9fcc-7d6107b52253 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Getting quotas for user 9f3bcbbebe354fe9a2a9ae24d7b792d1 and project 6c23fa4998bf4a8cb6fa05e019c813bd. Resources: {'key_pairs'} {{(pid=107485) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 07 05:01:18.950333 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.quota [None req-90a8ff69-76a5-4093-9fcc-7d6107b52253 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Getting quotas for project 6c23fa4998bf4a8cb6fa05e019c813bd. Resources: {'key_pairs'} {{(pid=107485) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 07 05:01:18.953914 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.quota [None req-90a8ff69-76a5-4093-9fcc-7d6107b52253 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Getting quotas for user 9f3bcbbebe354fe9a2a9ae24d7b792d1 and project 6c23fa4998bf4a8cb6fa05e019c813bd. Resources: {'key_pairs'} {{(pid=107485) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 07 05:01:18.966634 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-90a8ff69-76a5-4093-9fcc-7d6107b52253 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.511675 Aug 07 05:01:18.967209 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 459/959] 10.222.0.35 () {62 vars in 1199 bytes} [Sat Aug 7 05:01:18 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 513 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Aug 07 05:01:20.280871 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-19c8df4d-c736-47b8-8d2d-0004148a1f77 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-955827399", "imageRef": "ddcf95b5-3ea4-4a61-8f54-4b2feadb8682", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fc7aefab-048b-463e-a51e-c06e7a8144a6"}], "security_groups": [{"name": "tempest-securitygroup--62001427"}], "key_name": "tempest-keypair-449470537", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:01:20.373149 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.network.neutron [None req-19c8df4d-c736-47b8-8d2d-0004148a1f77 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] validate_networks() for [('fc7aefab-048b-463e-a51e-c06e7a8144a6', None, None, None)] {{(pid=107486) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 07 05:01:20.740493 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.virt.hardware [None req-19c8df4d-c736-47b8-8d2d-0004148a1f77 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Flavor limits 0:0:0 {{(pid=107486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 05:01:20.740947 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.virt.hardware [None req-19c8df4d-c736-47b8-8d2d-0004148a1f77 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Image limits 0:0:0 {{(pid=107486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 05:01:20.741415 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.virt.hardware [None req-19c8df4d-c736-47b8-8d2d-0004148a1f77 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Flavor pref 0:0:0 {{(pid=107486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 05:01:20.741814 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.virt.hardware [None req-19c8df4d-c736-47b8-8d2d-0004148a1f77 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Image pref 0:0:0 {{(pid=107486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 05:01:20.742214 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.virt.hardware [None req-19c8df4d-c736-47b8-8d2d-0004148a1f77 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 05:01:20.751755 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-19c8df4d-c736-47b8-8d2d-0004148a1f77 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:20.752201 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-19c8df4d-c736-47b8-8d2d-0004148a1f77 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:20.753037 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-19c8df4d-c736-47b8-8d2d-0004148a1f77 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:20.753476 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-19c8df4d-c736-47b8-8d2d-0004148a1f77 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:20.769788 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.quota [None req-19c8df4d-c736-47b8-8d2d-0004148a1f77 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Getting quotas for project 6c23fa4998bf4a8cb6fa05e019c813bd. Resources: {'ram', 'cores', 'instances'} {{(pid=107486) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 07 05:01:20.773634 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.quota [None req-19c8df4d-c736-47b8-8d2d-0004148a1f77 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Getting quotas for user 9f3bcbbebe354fe9a2a9ae24d7b792d1 and project 6c23fa4998bf4a8cb6fa05e019c813bd. Resources: {'ram', 'cores', 'instances'} {{(pid=107486) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 07 05:01:20.784571 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-19c8df4d-c736-47b8-8d2d-0004148a1f77 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Going to run 1 instances... {{(pid=107486) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 07 05:01:20.786942 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-19c8df4d-c736-47b8-8d2d-0004148a1f77 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ddcf95b5-3ea4-4a61-8f54-4b2feadb8682',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107486) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 07 05:01:20.834371 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-19c8df4d-c736-47b8-8d2d-0004148a1f77 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.558164 Aug 07 05:01:20.835016 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 501/960] 10.222.0.35 () {62 vars in 1188 bytes} [Sat Aug 7 05:01:20 2021] POST /compute/v2.1/servers => generated 400 bytes in 560 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 07 05:01:20.844754 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-42c821a9-99d0-430b-8769-799da5c4f65d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:01:20.845378 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-42c821a9-99d0-430b-8769-799da5c4f65d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:01:20.895981 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-42c821a9-99d0-430b-8769-799da5c4f65d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:01:20.903271 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-42c821a9-99d0-430b-8769-799da5c4f65d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:01:20.904866 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-42c821a9-99d0-430b-8769-799da5c4f65d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:01:20.906014 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-42c821a9-99d0-430b-8769-799da5c4f65d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1280 microversion: 2.20 time: 0.065040 Aug 07 05:01:20.906743 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 460/961] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:01:20 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1280 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 05:01:21.924021 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-7f64d9ec-7823-4ba8-8a35-66f6ec579cdf tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:01:21.924639 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-7f64d9ec-7823-4ba8-8a35-66f6ec579cdf tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:01:21.931513 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-7f64d9ec-7823-4ba8-8a35-66f6ec579cdf tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:21.931956 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-7f64d9ec-7823-4ba8-8a35-66f6ec579cdf tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:21.932722 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-7f64d9ec-7823-4ba8-8a35-66f6ec579cdf tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:21.933355 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-7f64d9ec-7823-4ba8-8a35-66f6ec579cdf tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:22.000301 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-7f64d9ec-7823-4ba8-8a35-66f6ec579cdf tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:01:22.008069 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-7f64d9ec-7823-4ba8-8a35-66f6ec579cdf tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:01:22.009581 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-7f64d9ec-7823-4ba8-8a35-66f6ec579cdf tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:01:22.010647 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-7f64d9ec-7823-4ba8-8a35-66f6ec579cdf tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1338 microversion: 2.20 time: 0.090466 Aug 07 05:01:22.011200 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 502/962] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:01:21 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1338 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 05:01:23.030875 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-4c9d327d-e33a-48ce-bbf0-bd9c51572048 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:01:23.031514 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-4c9d327d-e33a-48ce-bbf0-bd9c51572048 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:01:23.038425 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4c9d327d-e33a-48ce-bbf0-bd9c51572048 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:23.038756 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4c9d327d-e33a-48ce-bbf0-bd9c51572048 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:23.039562 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4c9d327d-e33a-48ce-bbf0-bd9c51572048 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:23.039945 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4c9d327d-e33a-48ce-bbf0-bd9c51572048 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:23.225273 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [req-9cb0ba3f-817c-43ba-af39-26ae2177fe2b req-e5e3deda-675c-4487-82cf-34ed3b8f42bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c28c4450-6a8b-4d0b-b175-29ed3a3b148c", "tag": "92b05688-e614-4cbb-9a2c-05ff3d513b8a"}]} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:01:23.227817 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 05:01:23.227817 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: warnings.warn(msg) Aug 07 05:01:23.237813 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-9cb0ba3f-817c-43ba-af39-26ae2177fe2b req-e5e3deda-675c-4487-82cf-34ed3b8f42bc service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:23.238352 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-9cb0ba3f-817c-43ba-af39-26ae2177fe2b req-e5e3deda-675c-4487-82cf-34ed3b8f42bc service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:23.251156 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-4c9d327d-e33a-48ce-bbf0-bd9c51572048 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:01:23.251506 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.compute.server_external_events [req-9cb0ba3f-817c-43ba-af39-26ae2177fe2b req-e5e3deda-675c-4487-82cf-34ed3b8f42bc service nova] Creating event network-changed:92b05688-e614-4cbb-9a2c-05ff3d513b8a for instance c28c4450-6a8b-4d0b-b175-29ed3a3b148c on hv-cinder-80374 Aug 07 05:01:23.258532 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [req-9cb0ba3f-817c-43ba-af39-26ae2177fe2b req-e5e3deda-675c-4487-82cf-34ed3b8f42bc service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038195 Aug 07 05:01:23.259298 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 503/963] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 05:01:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 05:01:23.261219 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-4c9d327d-e33a-48ce-bbf0-bd9c51572048 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:01:23.263869 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-4c9d327d-e33a-48ce-bbf0-bd9c51572048 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:01:23.265010 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-4c9d327d-e33a-48ce-bbf0-bd9c51572048 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1404 microversion: 2.20 time: 0.240223 Aug 07 05:01:23.265557 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 461/964] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:01:23 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1404 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 05:01:24.285049 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-cf93f31d-e187-4345-accf-8308cc7ed6b1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:01:24.285741 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-cf93f31d-e187-4345-accf-8308cc7ed6b1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:01:24.292549 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-cf93f31d-e187-4345-accf-8308cc7ed6b1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:24.293244 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-cf93f31d-e187-4345-accf-8308cc7ed6b1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:24.294961 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-cf93f31d-e187-4345-accf-8308cc7ed6b1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:24.295744 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-cf93f31d-e187-4345-accf-8308cc7ed6b1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:24.422773 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-cf93f31d-e187-4345-accf-8308cc7ed6b1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:01:24.430817 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-cf93f31d-e187-4345-accf-8308cc7ed6b1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:01:24.432353 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-cf93f31d-e187-4345-accf-8308cc7ed6b1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:01:24.433460 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-cf93f31d-e187-4345-accf-8308cc7ed6b1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1404 microversion: 2.20 time: 0.152857 Aug 07 05:01:24.434055 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 504/965] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:01:24 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1404 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 05:01:25.455761 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-27b91bfb-4d5f-4c48-9557-d9499c600860 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:01:25.456435 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-27b91bfb-4d5f-4c48-9557-d9499c600860 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:01:25.462843 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-27b91bfb-4d5f-4c48-9557-d9499c600860 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:25.463284 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-27b91bfb-4d5f-4c48-9557-d9499c600860 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:25.464041 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-27b91bfb-4d5f-4c48-9557-d9499c600860 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:25.464470 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-27b91bfb-4d5f-4c48-9557-d9499c600860 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:25.836846 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-27b91bfb-4d5f-4c48-9557-d9499c600860 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:01:25.845282 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-27b91bfb-4d5f-4c48-9557-d9499c600860 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:01:25.846808 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-27b91bfb-4d5f-4c48-9557-d9499c600860 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:01:25.847893 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-27b91bfb-4d5f-4c48-9557-d9499c600860 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1404 microversion: 2.20 time: 0.395854 Aug 07 05:01:25.848449 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 462/966] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:01:25 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1404 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 05:01:26.866067 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-f6950423-0c82-4727-a888-2433432756c7 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:01:26.866603 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-f6950423-0c82-4727-a888-2433432756c7 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:01:26.873309 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f6950423-0c82-4727-a888-2433432756c7 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:26.873743 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f6950423-0c82-4727-a888-2433432756c7 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:26.874498 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f6950423-0c82-4727-a888-2433432756c7 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:26.874926 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f6950423-0c82-4727-a888-2433432756c7 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:26.996617 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-f6950423-0c82-4727-a888-2433432756c7 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:01:27.005488 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-f6950423-0c82-4727-a888-2433432756c7 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:01:27.007094 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-f6950423-0c82-4727-a888-2433432756c7 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:01:27.008263 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-f6950423-0c82-4727-a888-2433432756c7 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1404 microversion: 2.20 time: 0.146283 Aug 07 05:01:27.008855 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 505/967] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:01:26 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1404 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 05:01:28.027012 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-e21c1e95-a248-47c0-a5d8-179c7f256297 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:01:28.027619 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-e21c1e95-a248-47c0-a5d8-179c7f256297 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:01:28.033978 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e21c1e95-a248-47c0-a5d8-179c7f256297 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:28.034423 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e21c1e95-a248-47c0-a5d8-179c7f256297 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:28.035198 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e21c1e95-a248-47c0-a5d8-179c7f256297 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:28.035631 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e21c1e95-a248-47c0-a5d8-179c7f256297 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:28.158932 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-e21c1e95-a248-47c0-a5d8-179c7f256297 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:01:28.166556 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-e21c1e95-a248-47c0-a5d8-179c7f256297 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:01:28.168021 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-e21c1e95-a248-47c0-a5d8-179c7f256297 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:01:28.169243 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-e21c1e95-a248-47c0-a5d8-179c7f256297 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1404 microversion: 2.20 time: 0.145936 Aug 07 05:01:28.169796 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 463/968] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:01:28 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1404 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 05:01:29.187436 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-8511f9ed-da8d-414f-bcd7-142a4ef9f7bf tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:01:29.188054 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-8511f9ed-da8d-414f-bcd7-142a4ef9f7bf tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:01:29.194486 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8511f9ed-da8d-414f-bcd7-142a4ef9f7bf tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:29.194926 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8511f9ed-da8d-414f-bcd7-142a4ef9f7bf tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:29.195682 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8511f9ed-da8d-414f-bcd7-142a4ef9f7bf tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:29.196110 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8511f9ed-da8d-414f-bcd7-142a4ef9f7bf tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:29.313928 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-8511f9ed-da8d-414f-bcd7-142a4ef9f7bf tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:01:29.321537 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-8511f9ed-da8d-414f-bcd7-142a4ef9f7bf tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:01:29.323010 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-8511f9ed-da8d-414f-bcd7-142a4ef9f7bf tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:01:29.324074 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-8511f9ed-da8d-414f-bcd7-142a4ef9f7bf tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1404 microversion: 2.20 time: 0.140543 Aug 07 05:01:29.325194 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 506/969] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:01:29 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1404 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 05:01:30.102205 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [req-579d38a2-fef9-4704-9410-80ae61845ea6 req-1672f57d-e3a4-4a05-af77-d1ecb2d1d47f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c28c4450-6a8b-4d0b-b175-29ed3a3b148c", "name": "network-vif-plugged", "status": "completed", "tag": "92b05688-e614-4cbb-9a2c-05ff3d513b8a"}]} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:01:30.104425 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 05:01:30.104425 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: warnings.warn(msg) Aug 07 05:01:30.116816 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-579d38a2-fef9-4704-9410-80ae61845ea6 req-1672f57d-e3a4-4a05-af77-d1ecb2d1d47f service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:30.117385 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-579d38a2-fef9-4704-9410-80ae61845ea6 req-1672f57d-e3a4-4a05-af77-d1ecb2d1d47f service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:30.135607 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.compute.server_external_events [req-579d38a2-fef9-4704-9410-80ae61845ea6 req-1672f57d-e3a4-4a05-af77-d1ecb2d1d47f service nova] Creating event network-vif-plugged:92b05688-e614-4cbb-9a2c-05ff3d513b8a for instance c28c4450-6a8b-4d0b-b175-29ed3a3b148c on hv-cinder-80374 Aug 07 05:01:30.140985 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [req-579d38a2-fef9-4704-9410-80ae61845ea6 req-1672f57d-e3a4-4a05-af77-d1ecb2d1d47f service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042977 Aug 07 05:01:30.141603 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 464/970] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 05:01:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 05:01:30.342853 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-2c675b8b-8c1b-4fa7-895f-3465d76adf1b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:01:30.343447 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-2c675b8b-8c1b-4fa7-895f-3465d76adf1b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:01:30.349227 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2c675b8b-8c1b-4fa7-895f-3465d76adf1b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:30.349666 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2c675b8b-8c1b-4fa7-895f-3465d76adf1b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:30.350429 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2c675b8b-8c1b-4fa7-895f-3465d76adf1b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:30.350857 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2c675b8b-8c1b-4fa7-895f-3465d76adf1b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:30.471599 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-2c675b8b-8c1b-4fa7-895f-3465d76adf1b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:01:30.479443 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-2c675b8b-8c1b-4fa7-895f-3465d76adf1b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:01:30.481529 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-2c675b8b-8c1b-4fa7-895f-3465d76adf1b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:01:30.482597 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-2c675b8b-8c1b-4fa7-895f-3465d76adf1b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1404 microversion: 2.20 time: 0.144092 Aug 07 05:01:30.483160 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 507/971] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:01:30 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1404 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 05:01:31.500528 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-569e6795-82ce-4144-bf27-7114ba7758cf tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:01:31.501250 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-569e6795-82ce-4144-bf27-7114ba7758cf tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:01:31.507415 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-569e6795-82ce-4144-bf27-7114ba7758cf tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:31.507859 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-569e6795-82ce-4144-bf27-7114ba7758cf tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:31.508627 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-569e6795-82ce-4144-bf27-7114ba7758cf tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:31.509092 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-569e6795-82ce-4144-bf27-7114ba7758cf tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:31.636441 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-569e6795-82ce-4144-bf27-7114ba7758cf tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:01:31.649952 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-569e6795-82ce-4144-bf27-7114ba7758cf tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:01:31.651527 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-569e6795-82ce-4144-bf27-7114ba7758cf tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:01:31.653760 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-569e6795-82ce-4144-bf27-7114ba7758cf tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1404 microversion: 2.20 time: 0.156619 Aug 07 05:01:31.654323 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 465/972] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:01:31 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1404 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 05:01:32.672104 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-3447f8be-1d8d-4f53-a3b0-df7f9db1c721 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:01:32.672709 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-3447f8be-1d8d-4f53-a3b0-df7f9db1c721 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:01:32.678601 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3447f8be-1d8d-4f53-a3b0-df7f9db1c721 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:32.679042 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3447f8be-1d8d-4f53-a3b0-df7f9db1c721 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:32.679800 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3447f8be-1d8d-4f53-a3b0-df7f9db1c721 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:32.680233 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3447f8be-1d8d-4f53-a3b0-df7f9db1c721 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:32.804589 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-3447f8be-1d8d-4f53-a3b0-df7f9db1c721 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:01:32.812373 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-3447f8be-1d8d-4f53-a3b0-df7f9db1c721 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:01:32.813907 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-3447f8be-1d8d-4f53-a3b0-df7f9db1c721 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:01:32.815037 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-3447f8be-1d8d-4f53-a3b0-df7f9db1c721 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1596 microversion: 2.20 time: 0.147495 Aug 07 05:01:32.815597 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 508/973] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:01:32 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1596 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 05:01:32.832672 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-70888e1f-cfc4-42e7-b01a-9523ff5630f7 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:01:32.833224 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-70888e1f-cfc4-42e7-b01a-9523ff5630f7 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:01:32.839310 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-70888e1f-cfc4-42e7-b01a-9523ff5630f7 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:32.839773 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-70888e1f-cfc4-42e7-b01a-9523ff5630f7 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:32.841441 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-70888e1f-cfc4-42e7-b01a-9523ff5630f7 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:32.841878 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-70888e1f-cfc4-42e7-b01a-9523ff5630f7 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:32.917814 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-70888e1f-cfc4-42e7-b01a-9523ff5630f7 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.088753 Aug 07 05:01:32.919004 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 466/974] 10.222.0.35 () {60 vars in 1316 bytes} [Sat Aug 7 05:01:32 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:01:33.837419 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-a78c26a4-8084-42f2-ba11-423cac4d87e1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:01:33.838500 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-a78c26a4-8084-42f2-ba11-423cac4d87e1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:01:33.839725 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [req-1c58dc97-fd3f-4cd3-8352-d6fe45c57a63 req-4ca56cc1-9904-4014-8729-339b6711c3c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c28c4450-6a8b-4d0b-b175-29ed3a3b148c", "tag": "92b05688-e614-4cbb-9a2c-05ff3d513b8a"}]} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:01:33.841911 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 05:01:33.841911 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: warnings.warn(msg) Aug 07 05:01:33.845595 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a78c26a4-8084-42f2-ba11-423cac4d87e1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:33.846119 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a78c26a4-8084-42f2-ba11-423cac4d87e1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:33.846910 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a78c26a4-8084-42f2-ba11-423cac4d87e1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:33.847346 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a78c26a4-8084-42f2-ba11-423cac4d87e1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:33.848599 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-1c58dc97-fd3f-4cd3-8352-d6fe45c57a63 req-4ca56cc1-9904-4014-8729-339b6711c3c5 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:33.849086 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-1c58dc97-fd3f-4cd3-8352-d6fe45c57a63 req-4ca56cc1-9904-4014-8729-339b6711c3c5 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:33.860765 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.compute.server_external_events [req-1c58dc97-fd3f-4cd3-8352-d6fe45c57a63 req-4ca56cc1-9904-4014-8729-339b6711c3c5 service nova] Creating event network-changed:92b05688-e614-4cbb-9a2c-05ff3d513b8a for instance c28c4450-6a8b-4d0b-b175-29ed3a3b148c on hv-cinder-80374 Aug 07 05:01:33.865738 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [req-1c58dc97-fd3f-4cd3-8352-d6fe45c57a63 req-4ca56cc1-9904-4014-8729-339b6711c3c5 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029533 Aug 07 05:01:33.866581 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 467/975] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 05:01:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 05:01:33.947897 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-a78c26a4-8084-42f2-ba11-423cac4d87e1 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 14 microversion: 2.20 time: 0.114601 Aug 07 05:01:33.948452 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 509/976] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:01:33 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:01:34.960175 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-165ae4e6-7ce3-482e-a911-57dafcbb18ec tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:01:34.961302 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-165ae4e6-7ce3-482e-a911-57dafcbb18ec tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:01:34.967415 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-165ae4e6-7ce3-482e-a911-57dafcbb18ec tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:34.967870 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-165ae4e6-7ce3-482e-a911-57dafcbb18ec tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:34.968637 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-165ae4e6-7ce3-482e-a911-57dafcbb18ec tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:34.969111 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-165ae4e6-7ce3-482e-a911-57dafcbb18ec tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:35.048431 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-165ae4e6-7ce3-482e-a911-57dafcbb18ec tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 14 microversion: 2.20 time: 0.092367 Aug 07 05:01:35.049207 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 468/977] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:01:34 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:01:36.060086 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-d8ef7469-e0ef-44dc-b431-14066ead33c7 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:01:36.061169 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-d8ef7469-e0ef-44dc-b431-14066ead33c7 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:01:36.067565 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d8ef7469-e0ef-44dc-b431-14066ead33c7 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:36.068004 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d8ef7469-e0ef-44dc-b431-14066ead33c7 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:36.068764 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d8ef7469-e0ef-44dc-b431-14066ead33c7 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:36.069217 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d8ef7469-e0ef-44dc-b431-14066ead33c7 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:36.149739 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-d8ef7469-e0ef-44dc-b431-14066ead33c7 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 14 microversion: 2.20 time: 0.093756 Aug 07 05:01:36.150256 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 510/978] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:01:36 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:01:37.161179 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-7340ebd8-6ee0-43ec-b1c3-b1212722bfcb tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:01:37.162171 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-7340ebd8-6ee0-43ec-b1c3-b1212722bfcb tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:01:37.169256 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7340ebd8-6ee0-43ec-b1c3-b1212722bfcb tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:37.169698 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7340ebd8-6ee0-43ec-b1c3-b1212722bfcb tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:37.170456 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7340ebd8-6ee0-43ec-b1c3-b1212722bfcb tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:37.170951 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7340ebd8-6ee0-43ec-b1c3-b1212722bfcb tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:37.267740 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-7340ebd8-6ee0-43ec-b1c3-b1212722bfcb tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 14 microversion: 2.20 time: 0.110466 Aug 07 05:01:37.268293 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 469/979] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:01:37 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:01:38.279469 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-267dd935-7114-48d0-a8bf-c2f74f0c040a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:01:38.280468 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-267dd935-7114-48d0-a8bf-c2f74f0c040a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:01:38.287007 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-267dd935-7114-48d0-a8bf-c2f74f0c040a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:38.287453 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-267dd935-7114-48d0-a8bf-c2f74f0c040a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:38.288230 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-267dd935-7114-48d0-a8bf-c2f74f0c040a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:38.288663 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-267dd935-7114-48d0-a8bf-c2f74f0c040a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:38.378665 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-267dd935-7114-48d0-a8bf-c2f74f0c040a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 14 microversion: 2.20 time: 0.103452 Aug 07 05:01:38.379273 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 511/980] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:01:38 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:01:39.390944 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-e7d6195b-c25f-489b-b57c-d52d714c6186 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:01:39.391930 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-e7d6195b-c25f-489b-b57c-d52d714c6186 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:01:39.398494 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e7d6195b-c25f-489b-b57c-d52d714c6186 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:39.398942 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e7d6195b-c25f-489b-b57c-d52d714c6186 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:39.399706 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e7d6195b-c25f-489b-b57c-d52d714c6186 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:39.400137 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e7d6195b-c25f-489b-b57c-d52d714c6186 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:39.483661 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-e7d6195b-c25f-489b-b57c-d52d714c6186 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 14 microversion: 2.20 time: 0.097493 Aug 07 05:01:39.484267 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 470/981] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:01:39 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:01:40.495385 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-14d1ea3a-c805-41c1-ad2a-16f27431d488 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:01:40.497066 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-14d1ea3a-c805-41c1-ad2a-16f27431d488 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:01:40.503585 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-14d1ea3a-c805-41c1-ad2a-16f27431d488 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:40.504036 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-14d1ea3a-c805-41c1-ad2a-16f27431d488 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:40.504829 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-14d1ea3a-c805-41c1-ad2a-16f27431d488 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:40.505269 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-14d1ea3a-c805-41c1-ad2a-16f27431d488 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:40.586817 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-14d1ea3a-c805-41c1-ad2a-16f27431d488 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 14 microversion: 2.20 time: 0.095353 Aug 07 05:01:40.587416 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 512/982] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:01:40 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:01:41.598826 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-9abd53be-5398-47f2-b4b0-d3dd6a6ec810 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:01:41.599811 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-9abd53be-5398-47f2-b4b0-d3dd6a6ec810 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:01:41.606544 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9abd53be-5398-47f2-b4b0-d3dd6a6ec810 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:41.606990 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9abd53be-5398-47f2-b4b0-d3dd6a6ec810 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:41.607754 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9abd53be-5398-47f2-b4b0-d3dd6a6ec810 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:41.608182 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9abd53be-5398-47f2-b4b0-d3dd6a6ec810 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:41.706969 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-9abd53be-5398-47f2-b4b0-d3dd6a6ec810 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 14 microversion: 2.20 time: 0.112082 Aug 07 05:01:41.707735 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 471/983] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:01:41 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:01:42.718296 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-21466e04-4d7d-49df-8c0d-b15ae8261e62 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:01:42.719283 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-21466e04-4d7d-49df-8c0d-b15ae8261e62 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:01:42.725795 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-21466e04-4d7d-49df-8c0d-b15ae8261e62 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:42.726237 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-21466e04-4d7d-49df-8c0d-b15ae8261e62 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:42.726996 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-21466e04-4d7d-49df-8c0d-b15ae8261e62 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:42.727438 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-21466e04-4d7d-49df-8c0d-b15ae8261e62 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:42.807443 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-21466e04-4d7d-49df-8c0d-b15ae8261e62 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 14 microversion: 2.20 time: 0.093580 Aug 07 05:01:42.808082 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 513/984] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:01:42 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 05:01:43.818753 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-02ec0428-700d-4c0e-b0ff-672be6afdd7d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:01:43.819759 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-02ec0428-700d-4c0e-b0ff-672be6afdd7d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:01:43.826964 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-02ec0428-700d-4c0e-b0ff-672be6afdd7d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:43.827406 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-02ec0428-700d-4c0e-b0ff-672be6afdd7d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:43.828157 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-02ec0428-700d-4c0e-b0ff-672be6afdd7d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:43.828585 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-02ec0428-700d-4c0e-b0ff-672be6afdd7d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:43.912187 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-02ec0428-700d-4c0e-b0ff-672be6afdd7d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 14 microversion: 2.20 time: 0.097266 Aug 07 05:01:43.912826 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 472/985] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:01:43 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:01:44.923941 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-a034c294-ee21-4b0a-b4b7-52f34dbee0ec tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:01:44.924900 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-a034c294-ee21-4b0a-b4b7-52f34dbee0ec tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:01:44.931412 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a034c294-ee21-4b0a-b4b7-52f34dbee0ec tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:44.931879 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a034c294-ee21-4b0a-b4b7-52f34dbee0ec tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:44.932651 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a034c294-ee21-4b0a-b4b7-52f34dbee0ec tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:44.933111 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a034c294-ee21-4b0a-b4b7-52f34dbee0ec tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:45.026366 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-a034c294-ee21-4b0a-b4b7-52f34dbee0ec tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 12971 microversion: 2.20 time: 0.106397 Aug 07 05:01:45.027589 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 514/986] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:01:44 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 12971 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:01:46.038354 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-780f20bc-e750-4ec6-aa4f-c7ad1cbdaa79 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:01:46.039262 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-780f20bc-e750-4ec6-aa4f-c7ad1cbdaa79 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:01:46.046229 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-780f20bc-e750-4ec6-aa4f-c7ad1cbdaa79 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:46.046675 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-780f20bc-e750-4ec6-aa4f-c7ad1cbdaa79 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:46.047441 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-780f20bc-e750-4ec6-aa4f-c7ad1cbdaa79 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:46.047882 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-780f20bc-e750-4ec6-aa4f-c7ad1cbdaa79 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:46.141888 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-780f20bc-e750-4ec6-aa4f-c7ad1cbdaa79 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 18449 microversion: 2.20 time: 0.107600 Aug 07 05:01:46.142501 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 473/987] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:01:46 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 18449 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:01:47.153784 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-518b2138-b70c-465b-8e73-423c3d631faf tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:01:47.154769 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-518b2138-b70c-465b-8e73-423c3d631faf tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:01:47.161198 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-518b2138-b70c-465b-8e73-423c3d631faf tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:47.161639 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-518b2138-b70c-465b-8e73-423c3d631faf tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:47.162399 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-518b2138-b70c-465b-8e73-423c3d631faf tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:47.162826 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-518b2138-b70c-465b-8e73-423c3d631faf tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:47.253422 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-518b2138-b70c-465b-8e73-423c3d631faf tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 19342 microversion: 2.20 time: 0.103524 Aug 07 05:01:47.254037 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 515/988] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:01:47 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 19342 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:01:48.266096 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-97d139d4-c87f-4388-b3a2-a29f2c9dfd90 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:01:48.267093 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-97d139d4-c87f-4388-b3a2-a29f2c9dfd90 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:01:48.273575 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-97d139d4-c87f-4388-b3a2-a29f2c9dfd90 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:48.274024 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-97d139d4-c87f-4388-b3a2-a29f2c9dfd90 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:48.274794 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-97d139d4-c87f-4388-b3a2-a29f2c9dfd90 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:48.275237 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-97d139d4-c87f-4388-b3a2-a29f2c9dfd90 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:48.371731 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-97d139d4-c87f-4388-b3a2-a29f2c9dfd90 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 21975 microversion: 2.20 time: 0.110420 Aug 07 05:01:48.372328 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 474/989] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:01:48 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 21975 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:01:49.383642 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-e30eb1ed-eea2-4bb9-bd3f-529f80c66924 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:01:49.384622 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-e30eb1ed-eea2-4bb9-bd3f-529f80c66924 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:01:49.391686 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e30eb1ed-eea2-4bb9-bd3f-529f80c66924 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:49.392131 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e30eb1ed-eea2-4bb9-bd3f-529f80c66924 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:49.392905 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e30eb1ed-eea2-4bb9-bd3f-529f80c66924 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:49.393333 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e30eb1ed-eea2-4bb9-bd3f-529f80c66924 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:49.483107 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-e30eb1ed-eea2-4bb9-bd3f-529f80c66924 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 23243 microversion: 2.20 time: 0.103350 Aug 07 05:01:49.483711 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 516/990] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:01:49 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 23243 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:01:50.494987 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-ceb2a534-1aec-41a8-98d6-5d4b5491b545 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:01:50.495971 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-ceb2a534-1aec-41a8-98d6-5d4b5491b545 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:01:50.502437 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ceb2a534-1aec-41a8-98d6-5d4b5491b545 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:50.502878 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ceb2a534-1aec-41a8-98d6-5d4b5491b545 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:50.503633 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ceb2a534-1aec-41a8-98d6-5d4b5491b545 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:50.504061 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ceb2a534-1aec-41a8-98d6-5d4b5491b545 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:50.590484 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-ceb2a534-1aec-41a8-98d6-5d4b5491b545 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 24757 microversion: 2.20 time: 0.099407 Aug 07 05:01:50.591901 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 475/991] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:01:50 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 24757 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 07 05:01:51.603522 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-0d69a01f-6fb7-4bbf-8e9d-d15c0c1c903e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:01:51.604515 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-0d69a01f-6fb7-4bbf-8e9d-d15c0c1c903e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:01:51.611267 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0d69a01f-6fb7-4bbf-8e9d-d15c0c1c903e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:51.611700 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0d69a01f-6fb7-4bbf-8e9d-d15c0c1c903e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:51.612473 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0d69a01f-6fb7-4bbf-8e9d-d15c0c1c903e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:51.612998 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0d69a01f-6fb7-4bbf-8e9d-d15c0c1c903e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:51.710021 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-0d69a01f-6fb7-4bbf-8e9d-d15c0c1c903e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 26338 microversion: 2.20 time: 0.110933 Aug 07 05:01:51.710692 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 517/992] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:01:51 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 26338 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:01:52.722284 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-b27a859d-e5c7-438e-b4b2-95ad96e18f90 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:01:52.723265 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-b27a859d-e5c7-438e-b4b2-95ad96e18f90 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:01:52.729703 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b27a859d-e5c7-438e-b4b2-95ad96e18f90 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:52.730141 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b27a859d-e5c7-438e-b4b2-95ad96e18f90 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:52.730895 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b27a859d-e5c7-438e-b4b2-95ad96e18f90 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:52.731432 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b27a859d-e5c7-438e-b4b2-95ad96e18f90 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:52.823782 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-b27a859d-e5c7-438e-b4b2-95ad96e18f90 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 27453 microversion: 2.20 time: 0.105478 Aug 07 05:01:52.824402 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 476/993] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:01:52 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 27453 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:01:53.836936 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-7828df53-047d-4b21-a532-d66c44a49835 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:01:53.837927 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-7828df53-047d-4b21-a532-d66c44a49835 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:01:53.845481 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-7828df53-047d-4b21-a532-d66c44a49835 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:53.845934 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-7828df53-047d-4b21-a532-d66c44a49835 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:53.846851 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-7828df53-047d-4b21-a532-d66c44a49835 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:53.847297 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-7828df53-047d-4b21-a532-d66c44a49835 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:53.951838 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-7828df53-047d-4b21-a532-d66c44a49835 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 27806 microversion: 2.20 time: 0.118302 Aug 07 05:01:53.952460 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 518/994] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:01:53 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 27806 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:01:54.964149 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-0d2e35aa-7ebf-480a-9356-ff796128f642 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:01:54.965099 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-0d2e35aa-7ebf-480a-9356-ff796128f642 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:01:54.972186 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0d2e35aa-7ebf-480a-9356-ff796128f642 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:54.972636 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0d2e35aa-7ebf-480a-9356-ff796128f642 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:54.973439 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0d2e35aa-7ebf-480a-9356-ff796128f642 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:54.973878 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0d2e35aa-7ebf-480a-9356-ff796128f642 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:55.072904 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-0d2e35aa-7ebf-480a-9356-ff796128f642 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 28229 microversion: 2.20 time: 0.112671 Aug 07 05:01:55.073804 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 477/995] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:01:54 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 28229 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:01:56.085073 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-7ff812b4-caee-454a-bf13-05b6b09bc59d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:01:56.086060 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-7ff812b4-caee-454a-bf13-05b6b09bc59d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:01:56.093141 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-7ff812b4-caee-454a-bf13-05b6b09bc59d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:56.093584 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-7ff812b4-caee-454a-bf13-05b6b09bc59d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:56.094347 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-7ff812b4-caee-454a-bf13-05b6b09bc59d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:56.094775 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-7ff812b4-caee-454a-bf13-05b6b09bc59d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:56.195804 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-7ff812b4-caee-454a-bf13-05b6b09bc59d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 28229 microversion: 2.20 time: 0.114901 Aug 07 05:01:56.196408 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 519/996] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:01:56 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 28229 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:01:57.207588 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-3e79ba9a-f582-4305-bd75-74b4e18cdccf tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:01:57.208845 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-3e79ba9a-f582-4305-bd75-74b4e18cdccf tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:01:57.215318 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3e79ba9a-f582-4305-bd75-74b4e18cdccf tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:57.215791 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3e79ba9a-f582-4305-bd75-74b4e18cdccf tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:57.217119 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3e79ba9a-f582-4305-bd75-74b4e18cdccf tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:57.217552 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3e79ba9a-f582-4305-bd75-74b4e18cdccf tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:57.301295 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-3e79ba9a-f582-4305-bd75-74b4e18cdccf tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 28229 microversion: 2.20 time: 0.097464 Aug 07 05:01:57.301831 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 478/997] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:01:57 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 28229 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:01:58.313353 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-835d00ab-a05a-4fec-9809-da48362dea46 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:01:58.314381 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-835d00ab-a05a-4fec-9809-da48362dea46 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:01:58.321135 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-835d00ab-a05a-4fec-9809-da48362dea46 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:58.321591 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-835d00ab-a05a-4fec-9809-da48362dea46 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:58.322405 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-835d00ab-a05a-4fec-9809-da48362dea46 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:58.322842 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-835d00ab-a05a-4fec-9809-da48362dea46 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:58.415933 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-835d00ab-a05a-4fec-9809-da48362dea46 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 28229 microversion: 2.20 time: 0.106576 Aug 07 05:01:58.416540 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 520/998] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:01:58 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 28229 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:01:59.428706 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-2b177f84-8641-496a-a78f-3bbb68dc7f50 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:01:59.429730 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-2b177f84-8641-496a-a78f-3bbb68dc7f50 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:01:59.436286 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2b177f84-8641-496a-a78f-3bbb68dc7f50 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:59.436729 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2b177f84-8641-496a-a78f-3bbb68dc7f50 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:59.437530 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2b177f84-8641-496a-a78f-3bbb68dc7f50 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:01:59.437952 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2b177f84-8641-496a-a78f-3bbb68dc7f50 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:01:59.527930 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-2b177f84-8641-496a-a78f-3bbb68dc7f50 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 28229 microversion: 2.20 time: 0.103741 Aug 07 05:01:59.529884 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 479/999] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:01:59 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 28229 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:02:00.540772 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-f0971e71-6ba5-4d3a-8849-fa4c7acacdc9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:02:00.541780 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-f0971e71-6ba5-4d3a-8849-fa4c7acacdc9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:00.549175 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f0971e71-6ba5-4d3a-8849-fa4c7acacdc9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:00.549623 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f0971e71-6ba5-4d3a-8849-fa4c7acacdc9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:00.550386 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f0971e71-6ba5-4d3a-8849-fa4c7acacdc9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:00.550817 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f0971e71-6ba5-4d3a-8849-fa4c7acacdc9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:00.637107 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-f0971e71-6ba5-4d3a-8849-fa4c7acacdc9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 28229 microversion: 2.20 time: 0.100106 Aug 07 05:02:00.637742 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 521/1000] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:02:00 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 28229 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:02:01.649363 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-ed3a662e-134e-42ce-a17e-af442452b487 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:02:01.650380 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-ed3a662e-134e-42ce-a17e-af442452b487 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:01.656853 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ed3a662e-134e-42ce-a17e-af442452b487 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:01.657295 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ed3a662e-134e-42ce-a17e-af442452b487 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:01.658045 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ed3a662e-134e-42ce-a17e-af442452b487 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:01.658469 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ed3a662e-134e-42ce-a17e-af442452b487 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:01.749935 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-ed3a662e-134e-42ce-a17e-af442452b487 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 28229 microversion: 2.20 time: 0.104481 Aug 07 05:02:01.750861 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 480/1001] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:02:01 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 28229 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:02:02.764531 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-45d7217c-e57c-46a1-a51f-1b6f1bc0114c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:02:02.765567 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-45d7217c-e57c-46a1-a51f-1b6f1bc0114c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:02.772069 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-45d7217c-e57c-46a1-a51f-1b6f1bc0114c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:02.772511 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-45d7217c-e57c-46a1-a51f-1b6f1bc0114c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:02.773301 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-45d7217c-e57c-46a1-a51f-1b6f1bc0114c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:02.773726 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-45d7217c-e57c-46a1-a51f-1b6f1bc0114c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:02.862611 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-45d7217c-e57c-46a1-a51f-1b6f1bc0114c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 28229 microversion: 2.20 time: 0.102576 Aug 07 05:02:02.863277 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 522/1002] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:02:02 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 28229 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:02:03.874849 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-6223f8c0-525f-477b-9693-4c986ed17f17 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:02:03.875808 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-6223f8c0-525f-477b-9693-4c986ed17f17 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:03.882335 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6223f8c0-525f-477b-9693-4c986ed17f17 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:03.882786 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6223f8c0-525f-477b-9693-4c986ed17f17 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:03.883552 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6223f8c0-525f-477b-9693-4c986ed17f17 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:03.883986 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6223f8c0-525f-477b-9693-4c986ed17f17 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:03.971027 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-6223f8c0-525f-477b-9693-4c986ed17f17 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 28229 microversion: 2.20 time: 0.100426 Aug 07 05:02:03.971921 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 481/1003] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:02:03 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 28229 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:02:04.871977 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-de390960-35c8-4345-9184-17c2481f3edf tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:02:04.872517 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-de390960-35c8-4345-9184-17c2481f3edf tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] [instance: c0921101-facb-43a4-addf-1c9791448743] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:04.879616 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-de390960-35c8-4345-9184-17c2481f3edf tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:04.880059 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-de390960-35c8-4345-9184-17c2481f3edf tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:04.880833 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-de390960-35c8-4345-9184-17c2481f3edf tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:04.881267 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-de390960-35c8-4345-9184-17c2481f3edf tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:04.903330 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.objects.instance [None req-de390960-35c8-4345-9184-17c2481f3edf tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lazy-loading 'flavor' on Instance uuid c0921101-facb-43a4-addf-1c9791448743 {{(pid=107486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 05:02:04.974137 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-de390960-35c8-4345-9184-17c2481f3edf tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] 10.222.0.35 "POST /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743/action" status: 202 len: 0 microversion: 2.1 time: 0.106059 Aug 07 05:02:04.974694 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 523/1004] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:02:04 2021] POST /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:02:04.982898 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-e416f75d-3a10-434c-b133-b27e8155638c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:02:04.983438 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-f408d674-2d44-4aa1-a987-71a5769fb5c6 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:02:04.983588 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-f408d674-2d44-4aa1-a987-71a5769fb5c6 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] [instance: c0921101-facb-43a4-addf-1c9791448743] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:04.986920 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-e416f75d-3a10-434c-b133-b27e8155638c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:04.990177 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f408d674-2d44-4aa1-a987-71a5769fb5c6 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:04.990661 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f408d674-2d44-4aa1-a987-71a5769fb5c6 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:04.991645 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f408d674-2d44-4aa1-a987-71a5769fb5c6 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:04.992132 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f408d674-2d44-4aa1-a987-71a5769fb5c6 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:04.994298 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e416f75d-3a10-434c-b133-b27e8155638c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:04.995511 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e416f75d-3a10-434c-b133-b27e8155638c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:04.996394 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e416f75d-3a10-434c-b133-b27e8155638c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:04.997102 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e416f75d-3a10-434c-b133-b27e8155638c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:05.113866 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-f408d674-2d44-4aa1-a987-71a5769fb5c6 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fec41eb8ba14082b33f628c86fe48c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874042788a343ec976046e4394fa45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:02:05.121114 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-f408d674-2d44-4aa1-a987-71a5769fb5c6 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] 10.222.0.35 "GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743" status: 200 len: 1568 microversion: 2.1 time: 0.141997 Aug 07 05:02:05.121673 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 524/1005] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:02:04 2021] GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743 => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 05:02:05.129021 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-e416f75d-3a10-434c-b133-b27e8155638c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 28229 microversion: 2.20 time: 0.150121 Aug 07 05:02:05.129808 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 482/1006] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:02:04 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 28229 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:02:06.138711 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-179029a6-ca32-4ddb-b6cf-5d60e22769b2 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:02:06.139322 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-179029a6-ca32-4ddb-b6cf-5d60e22769b2 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] [instance: c0921101-facb-43a4-addf-1c9791448743] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:06.141338 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-3abb0d30-8cf2-41f2-8900-3a8640c619ee tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:02:06.142473 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-3abb0d30-8cf2-41f2-8900-3a8640c619ee tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:06.146638 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-179029a6-ca32-4ddb-b6cf-5d60e22769b2 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:06.147080 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-179029a6-ca32-4ddb-b6cf-5d60e22769b2 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:06.147932 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-179029a6-ca32-4ddb-b6cf-5d60e22769b2 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:06.148418 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-179029a6-ca32-4ddb-b6cf-5d60e22769b2 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:06.149032 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3abb0d30-8cf2-41f2-8900-3a8640c619ee tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:06.149477 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3abb0d30-8cf2-41f2-8900-3a8640c619ee tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:06.150267 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3abb0d30-8cf2-41f2-8900-3a8640c619ee tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:06.150691 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3abb0d30-8cf2-41f2-8900-3a8640c619ee tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:06.238086 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-3abb0d30-8cf2-41f2-8900-3a8640c619ee tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 28229 microversion: 2.20 time: 0.101285 Aug 07 05:02:06.241864 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 483/1007] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:02:06 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 28229 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 07 05:02:06.268427 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-179029a6-ca32-4ddb-b6cf-5d60e22769b2 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fec41eb8ba14082b33f628c86fe48c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874042788a343ec976046e4394fa45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:02:06.276007 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-179029a6-ca32-4ddb-b6cf-5d60e22769b2 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] 10.222.0.35 "GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743" status: 200 len: 1568 microversion: 2.1 time: 0.141006 Aug 07 05:02:06.276560 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 525/1008] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:02:06 2021] GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743 => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:02:07.250658 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-f4b1bf28-dcb3-4778-9ec2-ce3ea8243127 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:02:07.251804 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-f4b1bf28-dcb3-4778-9ec2-ce3ea8243127 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:07.258280 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f4b1bf28-dcb3-4778-9ec2-ce3ea8243127 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:07.258730 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f4b1bf28-dcb3-4778-9ec2-ce3ea8243127 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:07.259498 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f4b1bf28-dcb3-4778-9ec2-ce3ea8243127 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:07.259940 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f4b1bf28-dcb3-4778-9ec2-ce3ea8243127 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:07.293616 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-55653b0f-4d9c-44b7-8b9d-4417d0e75bfe tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:02:07.294217 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-55653b0f-4d9c-44b7-8b9d-4417d0e75bfe tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] [instance: c0921101-facb-43a4-addf-1c9791448743] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:07.300432 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-55653b0f-4d9c-44b7-8b9d-4417d0e75bfe tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:07.300911 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-55653b0f-4d9c-44b7-8b9d-4417d0e75bfe tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:07.301672 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-55653b0f-4d9c-44b7-8b9d-4417d0e75bfe tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:07.302097 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-55653b0f-4d9c-44b7-8b9d-4417d0e75bfe tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:07.342513 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-f4b1bf28-dcb3-4778-9ec2-ce3ea8243127 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 28229 microversion: 2.20 time: 0.096307 Aug 07 05:02:07.343867 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 484/1009] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:02:07 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 28229 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:02:07.428257 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-55653b0f-4d9c-44b7-8b9d-4417d0e75bfe tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fec41eb8ba14082b33f628c86fe48c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874042788a343ec976046e4394fa45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:02:07.435576 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-55653b0f-4d9c-44b7-8b9d-4417d0e75bfe tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] 10.222.0.35 "GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743" status: 200 len: 1568 microversion: 2.1 time: 0.145904 Aug 07 05:02:07.436136 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 526/1010] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:02:07 2021] GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743 => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 05:02:08.354192 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-8edfe14d-2b51-4300-bf6b-47a1afee71d0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:02:08.355184 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-8edfe14d-2b51-4300-bf6b-47a1afee71d0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:08.361678 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8edfe14d-2b51-4300-bf6b-47a1afee71d0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:08.362127 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8edfe14d-2b51-4300-bf6b-47a1afee71d0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:08.362888 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8edfe14d-2b51-4300-bf6b-47a1afee71d0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:08.363318 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8edfe14d-2b51-4300-bf6b-47a1afee71d0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:08.454010 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-8edfe14d-2b51-4300-bf6b-47a1afee71d0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 28519 microversion: 2.20 time: 0.103024 Aug 07 05:02:08.457714 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 485/1011] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:02:08 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 28519 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:02:08.457864 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-9229d42b-4091-44bd-aa46-3e92c5f66411 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:02:08.457864 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-9229d42b-4091-44bd-aa46-3e92c5f66411 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] [instance: c0921101-facb-43a4-addf-1c9791448743] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:08.462235 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9229d42b-4091-44bd-aa46-3e92c5f66411 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:08.462670 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9229d42b-4091-44bd-aa46-3e92c5f66411 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:08.463430 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9229d42b-4091-44bd-aa46-3e92c5f66411 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:08.463861 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9229d42b-4091-44bd-aa46-3e92c5f66411 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:08.583033 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-9229d42b-4091-44bd-aa46-3e92c5f66411 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fec41eb8ba14082b33f628c86fe48c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874042788a343ec976046e4394fa45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:02:08.590557 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-9229d42b-4091-44bd-aa46-3e92c5f66411 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] 10.222.0.35 "GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743" status: 200 len: 1568 microversion: 2.1 time: 0.140343 Aug 07 05:02:08.591117 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 527/1012] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:02:08 2021] GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743 => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 05:02:09.465970 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-6636300a-ee8d-4850-983e-8ac2feae1629 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:02:09.466962 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-6636300a-ee8d-4850-983e-8ac2feae1629 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:09.474018 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6636300a-ee8d-4850-983e-8ac2feae1629 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:09.474469 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6636300a-ee8d-4850-983e-8ac2feae1629 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:09.475229 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6636300a-ee8d-4850-983e-8ac2feae1629 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:09.475695 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6636300a-ee8d-4850-983e-8ac2feae1629 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:09.564695 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-6636300a-ee8d-4850-983e-8ac2feae1629 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 28687 microversion: 2.20 time: 0.102551 Aug 07 05:02:09.565555 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 486/1013] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:02:09 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 28687 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 07 05:02:09.607028 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-ca070706-63e0-4cb5-ba80-90e6ac0778cc tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:02:09.607638 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-ca070706-63e0-4cb5-ba80-90e6ac0778cc tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] [instance: c0921101-facb-43a4-addf-1c9791448743] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:09.613680 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ca070706-63e0-4cb5-ba80-90e6ac0778cc tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:09.614126 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ca070706-63e0-4cb5-ba80-90e6ac0778cc tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:09.614905 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ca070706-63e0-4cb5-ba80-90e6ac0778cc tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:09.615341 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ca070706-63e0-4cb5-ba80-90e6ac0778cc tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:09.735980 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-ca070706-63e0-4cb5-ba80-90e6ac0778cc tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fec41eb8ba14082b33f628c86fe48c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874042788a343ec976046e4394fa45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:02:09.743248 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-ca070706-63e0-4cb5-ba80-90e6ac0778cc tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] 10.222.0.35 "GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743" status: 200 len: 1568 microversion: 2.1 time: 0.139862 Aug 07 05:02:09.743826 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 528/1014] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:02:09 2021] GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743 => generated 1568 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:02:10.577071 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-a4600e17-6f9b-42b6-b096-aa9aa8fdbfb8 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:02:10.578340 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-a4600e17-6f9b-42b6-b096-aa9aa8fdbfb8 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:10.585227 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a4600e17-6f9b-42b6-b096-aa9aa8fdbfb8 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:10.585673 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a4600e17-6f9b-42b6-b096-aa9aa8fdbfb8 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:10.586443 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a4600e17-6f9b-42b6-b096-aa9aa8fdbfb8 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:10.586874 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a4600e17-6f9b-42b6-b096-aa9aa8fdbfb8 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:10.673368 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-a4600e17-6f9b-42b6-b096-aa9aa8fdbfb8 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 28687 microversion: 2.20 time: 0.100194 Aug 07 05:02:10.674033 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 487/1015] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:02:10 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 28687 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:02:10.760870 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-5ff01428-bf8f-4578-b9cd-d469602c85af tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:02:10.761474 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-5ff01428-bf8f-4578-b9cd-d469602c85af tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] [instance: c0921101-facb-43a4-addf-1c9791448743] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:10.767531 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5ff01428-bf8f-4578-b9cd-d469602c85af tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:10.767966 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5ff01428-bf8f-4578-b9cd-d469602c85af tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:10.768722 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5ff01428-bf8f-4578-b9cd-d469602c85af tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:10.769178 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5ff01428-bf8f-4578-b9cd-d469602c85af tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:10.893977 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-5ff01428-bf8f-4578-b9cd-d469602c85af tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fec41eb8ba14082b33f628c86fe48c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874042788a343ec976046e4394fa45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:02:10.901378 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-5ff01428-bf8f-4578-b9cd-d469602c85af tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] 10.222.0.35 "GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743" status: 200 len: 1568 microversion: 2.1 time: 0.144313 Aug 07 05:02:10.901935 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 529/1016] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:02:10 2021] GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743 => generated 1568 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:02:11.685557 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-c0ff0925-4dbe-4a36-91e6-0e13275de78d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:02:11.686536 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-c0ff0925-4dbe-4a36-91e6-0e13275de78d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:11.693691 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c0ff0925-4dbe-4a36-91e6-0e13275de78d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:11.694132 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c0ff0925-4dbe-4a36-91e6-0e13275de78d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:11.694888 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c0ff0925-4dbe-4a36-91e6-0e13275de78d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:11.695315 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c0ff0925-4dbe-4a36-91e6-0e13275de78d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:11.775177 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-c0ff0925-4dbe-4a36-91e6-0e13275de78d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 28687 microversion: 2.20 time: 0.093516 Aug 07 05:02:11.775980 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 488/1017] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:02:11 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 28687 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:02:11.918613 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-31684457-5bc4-4da8-8535-a44d1a2230ca tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:02:11.919128 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-31684457-5bc4-4da8-8535-a44d1a2230ca tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] [instance: c0921101-facb-43a4-addf-1c9791448743] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:11.925545 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-31684457-5bc4-4da8-8535-a44d1a2230ca tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:11.925983 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-31684457-5bc4-4da8-8535-a44d1a2230ca tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:11.926736 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-31684457-5bc4-4da8-8535-a44d1a2230ca tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:11.927161 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-31684457-5bc4-4da8-8535-a44d1a2230ca tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:12.050819 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-31684457-5bc4-4da8-8535-a44d1a2230ca tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fec41eb8ba14082b33f628c86fe48c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874042788a343ec976046e4394fa45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:02:12.057992 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-31684457-5bc4-4da8-8535-a44d1a2230ca tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] 10.222.0.35 "GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743" status: 200 len: 1568 microversion: 2.1 time: 0.143038 Aug 07 05:02:12.058549 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 530/1018] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:02:11 2021] GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743 => generated 1568 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:02:12.787305 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-6c692730-c2c6-4220-b117-bdf03b03edf9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:02:12.788331 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-6c692730-c2c6-4220-b117-bdf03b03edf9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:12.794749 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6c692730-c2c6-4220-b117-bdf03b03edf9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:12.795170 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6c692730-c2c6-4220-b117-bdf03b03edf9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:12.795947 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6c692730-c2c6-4220-b117-bdf03b03edf9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:12.796378 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6c692730-c2c6-4220-b117-bdf03b03edf9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:12.878978 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-6c692730-c2c6-4220-b117-bdf03b03edf9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 28687 microversion: 2.20 time: 0.095490 Aug 07 05:02:12.879544 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 489/1019] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:02:12 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 28687 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:02:13.074836 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-e9cce3a7-d2f9-4b13-ab1c-4a83a5117b92 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:02:13.075446 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-e9cce3a7-d2f9-4b13-ab1c-4a83a5117b92 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] [instance: c0921101-facb-43a4-addf-1c9791448743] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:13.082453 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e9cce3a7-d2f9-4b13-ab1c-4a83a5117b92 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:13.082903 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e9cce3a7-d2f9-4b13-ab1c-4a83a5117b92 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:13.083933 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e9cce3a7-d2f9-4b13-ab1c-4a83a5117b92 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:13.084370 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e9cce3a7-d2f9-4b13-ab1c-4a83a5117b92 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:13.200041 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-e9cce3a7-d2f9-4b13-ab1c-4a83a5117b92 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fec41eb8ba14082b33f628c86fe48c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874042788a343ec976046e4394fa45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:02:13.207880 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-e9cce3a7-d2f9-4b13-ab1c-4a83a5117b92 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] 10.222.0.35 "GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743" status: 200 len: 1568 microversion: 2.1 time: 0.136749 Aug 07 05:02:13.208712 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 531/1020] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:02:13 2021] GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743 => generated 1568 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:02:13.891667 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-18d3d7cd-aa83-4392-bba6-6222b3e0cbe5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:02:13.892573 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-18d3d7cd-aa83-4392-bba6-6222b3e0cbe5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:13.899271 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-18d3d7cd-aa83-4392-bba6-6222b3e0cbe5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:13.899716 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-18d3d7cd-aa83-4392-bba6-6222b3e0cbe5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:13.900471 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-18d3d7cd-aa83-4392-bba6-6222b3e0cbe5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:13.900952 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-18d3d7cd-aa83-4392-bba6-6222b3e0cbe5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:13.981736 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-18d3d7cd-aa83-4392-bba6-6222b3e0cbe5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 28687 microversion: 2.20 time: 0.094659 Aug 07 05:02:13.982406 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 490/1021] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:02:13 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 28687 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 07 05:02:14.226857 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-f8aaffb3-9f36-4d84-be46-69d709d0cf4b tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:02:14.227429 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-f8aaffb3-9f36-4d84-be46-69d709d0cf4b tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] [instance: c0921101-facb-43a4-addf-1c9791448743] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:14.233300 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f8aaffb3-9f36-4d84-be46-69d709d0cf4b tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:14.233742 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f8aaffb3-9f36-4d84-be46-69d709d0cf4b tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:14.235078 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f8aaffb3-9f36-4d84-be46-69d709d0cf4b tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:14.235516 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f8aaffb3-9f36-4d84-be46-69d709d0cf4b tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:14.355912 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-f8aaffb3-9f36-4d84-be46-69d709d0cf4b tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fec41eb8ba14082b33f628c86fe48c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874042788a343ec976046e4394fa45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:02:14.363611 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-f8aaffb3-9f36-4d84-be46-69d709d0cf4b tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] 10.222.0.35 "GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743" status: 200 len: 1568 microversion: 2.1 time: 0.141948 Aug 07 05:02:14.364173 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 532/1022] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:02:14 2021] GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743 => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:02:14.993972 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-2b7a2a61-c36c-4578-aac5-b9c946f188f8 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:02:14.994877 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-2b7a2a61-c36c-4578-aac5-b9c946f188f8 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:15.001497 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2b7a2a61-c36c-4578-aac5-b9c946f188f8 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:15.001939 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2b7a2a61-c36c-4578-aac5-b9c946f188f8 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:15.002692 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2b7a2a61-c36c-4578-aac5-b9c946f188f8 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:15.003124 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2b7a2a61-c36c-4578-aac5-b9c946f188f8 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:15.085920 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-2b7a2a61-c36c-4578-aac5-b9c946f188f8 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 28687 microversion: 2.20 time: 0.095962 Aug 07 05:02:15.086532 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 491/1023] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:02:14 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 28687 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:02:15.379639 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-4d865257-5839-433a-985e-32822b46e19b tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:02:15.380330 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-4d865257-5839-433a-985e-32822b46e19b tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] [instance: c0921101-facb-43a4-addf-1c9791448743] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:15.386138 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4d865257-5839-433a-985e-32822b46e19b tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:15.386579 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4d865257-5839-433a-985e-32822b46e19b tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:15.387339 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4d865257-5839-433a-985e-32822b46e19b tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:15.387772 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4d865257-5839-433a-985e-32822b46e19b tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:15.506851 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-4d865257-5839-433a-985e-32822b46e19b tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fec41eb8ba14082b33f628c86fe48c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874042788a343ec976046e4394fa45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:02:15.514236 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-4d865257-5839-433a-985e-32822b46e19b tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] 10.222.0.35 "GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743" status: 200 len: 1568 microversion: 2.1 time: 0.138637 Aug 07 05:02:15.514818 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 533/1024] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:02:15 2021] GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743 => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:02:16.098732 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-1502be15-b95f-4fc5-a973-27105109b0ca tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:02:16.099722 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-1502be15-b95f-4fc5-a973-27105109b0ca tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:16.106198 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1502be15-b95f-4fc5-a973-27105109b0ca tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:16.106645 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1502be15-b95f-4fc5-a973-27105109b0ca tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:16.107414 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1502be15-b95f-4fc5-a973-27105109b0ca tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:16.107853 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1502be15-b95f-4fc5-a973-27105109b0ca tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:16.193986 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-1502be15-b95f-4fc5-a973-27105109b0ca tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 28687 microversion: 2.20 time: 0.099275 Aug 07 05:02:16.194620 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 492/1025] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:02:16 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 28687 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:02:16.531233 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-b354d1c1-d464-4d76-8542-b743eb15558d tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:02:16.531795 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-b354d1c1-d464-4d76-8542-b743eb15558d tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] [instance: c0921101-facb-43a4-addf-1c9791448743] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:16.541315 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b354d1c1-d464-4d76-8542-b743eb15558d tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:16.541764 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b354d1c1-d464-4d76-8542-b743eb15558d tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:16.542534 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b354d1c1-d464-4d76-8542-b743eb15558d tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:16.542970 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b354d1c1-d464-4d76-8542-b743eb15558d tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:16.660762 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-b354d1c1-d464-4d76-8542-b743eb15558d tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fec41eb8ba14082b33f628c86fe48c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874042788a343ec976046e4394fa45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:02:16.667992 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-b354d1c1-d464-4d76-8542-b743eb15558d tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] 10.222.0.35 "GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743" status: 200 len: 1568 microversion: 2.1 time: 0.140741 Aug 07 05:02:16.668557 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 534/1026] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:02:16 2021] GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743 => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:02:17.207543 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-620956d3-45a1-4700-9c8f-5dc8f90d6348 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:02:17.208778 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-620956d3-45a1-4700-9c8f-5dc8f90d6348 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:17.215020 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-620956d3-45a1-4700-9c8f-5dc8f90d6348 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:17.215467 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-620956d3-45a1-4700-9c8f-5dc8f90d6348 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:17.216224 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-620956d3-45a1-4700-9c8f-5dc8f90d6348 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:17.216652 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-620956d3-45a1-4700-9c8f-5dc8f90d6348 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:17.305022 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-620956d3-45a1-4700-9c8f-5dc8f90d6348 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 28687 microversion: 2.20 time: 0.102830 Aug 07 05:02:17.305643 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 493/1027] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:02:17 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 28687 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:02:17.684210 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-6abfd4e0-699e-49ec-9a49-fda0f3c49502 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:02:17.684831 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-6abfd4e0-699e-49ec-9a49-fda0f3c49502 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] [instance: c0921101-facb-43a4-addf-1c9791448743] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:17.691210 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6abfd4e0-699e-49ec-9a49-fda0f3c49502 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:17.691748 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6abfd4e0-699e-49ec-9a49-fda0f3c49502 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:17.692508 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6abfd4e0-699e-49ec-9a49-fda0f3c49502 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:17.693032 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6abfd4e0-699e-49ec-9a49-fda0f3c49502 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:17.822016 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-6abfd4e0-699e-49ec-9a49-fda0f3c49502 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fec41eb8ba14082b33f628c86fe48c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874042788a343ec976046e4394fa45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:02:17.830121 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-6abfd4e0-699e-49ec-9a49-fda0f3c49502 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] 10.222.0.35 "GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743" status: 200 len: 1568 microversion: 2.1 time: 0.149480 Aug 07 05:02:17.830701 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 535/1028] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:02:17 2021] GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:02:18.316583 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-93169826-6db2-4028-b711-e5c537f8e63c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:02:18.317566 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-93169826-6db2-4028-b711-e5c537f8e63c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:18.323968 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-93169826-6db2-4028-b711-e5c537f8e63c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:18.324419 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-93169826-6db2-4028-b711-e5c537f8e63c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:18.325226 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-93169826-6db2-4028-b711-e5c537f8e63c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:18.325664 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-93169826-6db2-4028-b711-e5c537f8e63c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:18.410348 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-93169826-6db2-4028-b711-e5c537f8e63c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 28687 microversion: 2.20 time: 0.098205 Aug 07 05:02:18.411013 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 494/1029] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:02:18 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 28687 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:02:18.847807 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-153ec4d4-0b00-4e1a-a44d-4e70ed752eb8 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:02:18.848439 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-153ec4d4-0b00-4e1a-a44d-4e70ed752eb8 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] [instance: c0921101-facb-43a4-addf-1c9791448743] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:18.854334 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-153ec4d4-0b00-4e1a-a44d-4e70ed752eb8 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:18.854771 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-153ec4d4-0b00-4e1a-a44d-4e70ed752eb8 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:18.855526 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-153ec4d4-0b00-4e1a-a44d-4e70ed752eb8 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:18.855950 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-153ec4d4-0b00-4e1a-a44d-4e70ed752eb8 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:18.972280 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-153ec4d4-0b00-4e1a-a44d-4e70ed752eb8 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fec41eb8ba14082b33f628c86fe48c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874042788a343ec976046e4394fa45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:02:18.979432 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-153ec4d4-0b00-4e1a-a44d-4e70ed752eb8 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] 10.222.0.35 "GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743" status: 200 len: 1509 microversion: 2.1 time: 0.136129 Aug 07 05:02:18.979991 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 536/1030] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:02:18 2021] GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743 => generated 1509 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:02:18.995662 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-143acd99-41a2-4f3c-aa88-86ccd3df733f tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:02:18.996308 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-143acd99-41a2-4f3c-aa88-86ccd3df733f tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] [instance: c0921101-facb-43a4-addf-1c9791448743] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:19.003716 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-143acd99-41a2-4f3c-aa88-86ccd3df733f tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:19.004167 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-143acd99-41a2-4f3c-aa88-86ccd3df733f tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:19.004991 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-143acd99-41a2-4f3c-aa88-86ccd3df733f tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:19.005424 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-143acd99-41a2-4f3c-aa88-86ccd3df733f tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:19.078145 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-143acd99-41a2-4f3c-aa88-86ccd3df733f tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] 10.222.0.35 "POST /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743/action" status: 202 len: 0 microversion: 2.1 time: 0.085946 Aug 07 05:02:19.078757 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 495/1031] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:02:18 2021] POST /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:02:19.086880 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-8f5cdebc-317f-4210-8c37-321fc6ced41c tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:02:19.087484 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-8f5cdebc-317f-4210-8c37-321fc6ced41c tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] [instance: c0921101-facb-43a4-addf-1c9791448743] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:19.093411 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8f5cdebc-317f-4210-8c37-321fc6ced41c tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:19.093686 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8f5cdebc-317f-4210-8c37-321fc6ced41c tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:19.094449 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8f5cdebc-317f-4210-8c37-321fc6ced41c tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:19.095298 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8f5cdebc-317f-4210-8c37-321fc6ced41c tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:19.232832 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-8f5cdebc-317f-4210-8c37-321fc6ced41c tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fec41eb8ba14082b33f628c86fe48c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874042788a343ec976046e4394fa45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:02:19.240781 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-8f5cdebc-317f-4210-8c37-321fc6ced41c tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] 10.222.0.35 "GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743" status: 200 len: 1517 microversion: 2.1 time: 0.157866 Aug 07 05:02:19.241441 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 537/1032] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:02:19 2021] GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743 => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:02:19.422451 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-f4680dba-6b09-4939-838e-94057c49432b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:02:19.423468 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-f4680dba-6b09-4939-838e-94057c49432b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:19.429930 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f4680dba-6b09-4939-838e-94057c49432b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:19.430383 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f4680dba-6b09-4939-838e-94057c49432b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:19.431167 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f4680dba-6b09-4939-838e-94057c49432b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:19.432107 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f4680dba-6b09-4939-838e-94057c49432b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:19.528826 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-f4680dba-6b09-4939-838e-94057c49432b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 28687 microversion: 2.20 time: 0.110598 Aug 07 05:02:19.529504 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 496/1033] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:02:19 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 28687 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:02:20.258665 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-b9c42b7a-b496-4f7f-8c67-0bbf603dd2d1 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:02:20.259310 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-b9c42b7a-b496-4f7f-8c67-0bbf603dd2d1 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] [instance: c0921101-facb-43a4-addf-1c9791448743] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:20.265464 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b9c42b7a-b496-4f7f-8c67-0bbf603dd2d1 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:20.265911 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b9c42b7a-b496-4f7f-8c67-0bbf603dd2d1 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:20.266681 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b9c42b7a-b496-4f7f-8c67-0bbf603dd2d1 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:20.267235 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b9c42b7a-b496-4f7f-8c67-0bbf603dd2d1 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:20.390966 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-b9c42b7a-b496-4f7f-8c67-0bbf603dd2d1 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fec41eb8ba14082b33f628c86fe48c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874042788a343ec976046e4394fa45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:02:20.398220 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-b9c42b7a-b496-4f7f-8c67-0bbf603dd2d1 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] 10.222.0.35 "GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743" status: 200 len: 1519 microversion: 2.1 time: 0.143319 Aug 07 05:02:20.398779 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 538/1034] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:02:20 2021] GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743 => generated 1519 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:02:20.541705 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-a0006f1d-418a-4886-9025-0f76bd979cf0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:02:20.543004 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-a0006f1d-418a-4886-9025-0f76bd979cf0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:20.550342 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a0006f1d-418a-4886-9025-0f76bd979cf0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:20.550784 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a0006f1d-418a-4886-9025-0f76bd979cf0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:20.551535 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a0006f1d-418a-4886-9025-0f76bd979cf0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:20.551962 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a0006f1d-418a-4886-9025-0f76bd979cf0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:20.651909 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-a0006f1d-418a-4886-9025-0f76bd979cf0 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 28687 microversion: 2.20 time: 0.113462 Aug 07 05:02:20.656892 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 497/1035] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:02:20 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 28687 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:02:21.416051 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-4ead8a3a-05bb-4326-905c-83bcd5083754 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:02:21.416645 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-4ead8a3a-05bb-4326-905c-83bcd5083754 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] [instance: c0921101-facb-43a4-addf-1c9791448743] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:21.424151 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4ead8a3a-05bb-4326-905c-83bcd5083754 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:21.424529 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4ead8a3a-05bb-4326-905c-83bcd5083754 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:21.425323 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4ead8a3a-05bb-4326-905c-83bcd5083754 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:21.425748 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4ead8a3a-05bb-4326-905c-83bcd5083754 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:21.544017 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-4ead8a3a-05bb-4326-905c-83bcd5083754 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fec41eb8ba14082b33f628c86fe48c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874042788a343ec976046e4394fa45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:02:21.551872 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-4ead8a3a-05bb-4326-905c-83bcd5083754 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] 10.222.0.35 "GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743" status: 200 len: 1575 microversion: 2.1 time: 0.139516 Aug 07 05:02:21.552434 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 539/1036] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:02:21 2021] GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743 => generated 1575 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:02:21.665370 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-61bca94e-926a-4e1f-a29f-a127d8a3e30e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:02:21.666371 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-61bca94e-926a-4e1f-a29f-a127d8a3e30e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:21.673633 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-61bca94e-926a-4e1f-a29f-a127d8a3e30e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:21.674086 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-61bca94e-926a-4e1f-a29f-a127d8a3e30e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:21.674903 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-61bca94e-926a-4e1f-a29f-a127d8a3e30e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:21.675293 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-61bca94e-926a-4e1f-a29f-a127d8a3e30e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:21.831598 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-61bca94e-926a-4e1f-a29f-a127d8a3e30e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 28687 microversion: 2.20 time: 0.170376 Aug 07 05:02:21.832569 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 498/1037] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:02:21 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 28687 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:02:22.267327 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [req-1f0068f6-2014-4a71-98d3-608e935e71dd req-f8f7ade0-f544-4d96-97b2-9b2aedeac285 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0921101-facb-43a4-addf-1c9791448743", "name": "network-vif-unplugged", "status": "completed", "tag": "018d5d66-f848-4b34-9a5e-9f813a6e1b80"}]} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:02:22.268872 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 05:02:22.268872 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: warnings.warn(msg) Aug 07 05:02:22.275714 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-1f0068f6-2014-4a71-98d3-608e935e71dd req-f8f7ade0-f544-4d96-97b2-9b2aedeac285 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:22.276406 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-1f0068f6-2014-4a71-98d3-608e935e71dd req-f8f7ade0-f544-4d96-97b2-9b2aedeac285 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:22.288358 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.compute.server_external_events [req-1f0068f6-2014-4a71-98d3-608e935e71dd req-f8f7ade0-f544-4d96-97b2-9b2aedeac285 service nova] Creating event network-vif-unplugged:018d5d66-f848-4b34-9a5e-9f813a6e1b80 for instance c0921101-facb-43a4-addf-1c9791448743 on hv-cinder-80374 Aug 07 05:02:22.293320 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [req-1f0068f6-2014-4a71-98d3-608e935e71dd req-f8f7ade0-f544-4d96-97b2-9b2aedeac285 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030200 Aug 07 05:02:22.293907 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 540/1038] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 05:02:22 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 05:02:22.569214 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-4c69674c-760a-404c-8c9e-12ad0badc613 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:02:22.569828 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-4c69674c-760a-404c-8c9e-12ad0badc613 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] [instance: c0921101-facb-43a4-addf-1c9791448743] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:22.576195 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4c69674c-760a-404c-8c9e-12ad0badc613 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:22.576638 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4c69674c-760a-404c-8c9e-12ad0badc613 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:22.578637 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4c69674c-760a-404c-8c9e-12ad0badc613 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:22.579086 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4c69674c-760a-404c-8c9e-12ad0badc613 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:22.705588 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-4c69674c-760a-404c-8c9e-12ad0badc613 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fec41eb8ba14082b33f628c86fe48c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874042788a343ec976046e4394fa45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:02:22.713174 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-4c69674c-760a-404c-8c9e-12ad0badc613 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] 10.222.0.35 "GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743" status: 200 len: 1575 microversion: 2.1 time: 0.148099 Aug 07 05:02:22.713739 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 499/1039] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:02:22 2021] GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743 => generated 1575 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:02:22.843971 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-6ea76f55-be0d-4d3f-b27f-0fcc13015219 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:02:22.845019 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-6ea76f55-be0d-4d3f-b27f-0fcc13015219 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:22.851132 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6ea76f55-be0d-4d3f-b27f-0fcc13015219 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:22.851554 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6ea76f55-be0d-4d3f-b27f-0fcc13015219 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:22.852317 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6ea76f55-be0d-4d3f-b27f-0fcc13015219 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:22.852749 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6ea76f55-be0d-4d3f-b27f-0fcc13015219 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:22.940335 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-6ea76f55-be0d-4d3f-b27f-0fcc13015219 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 28687 microversion: 2.20 time: 0.100397 Aug 07 05:02:22.941238 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 541/1040] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:02:22 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 28687 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:02:23.729506 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-f9116552-6d03-49a2-8396-696f91443c82 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:02:23.730109 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-f9116552-6d03-49a2-8396-696f91443c82 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] [instance: c0921101-facb-43a4-addf-1c9791448743] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:23.736379 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f9116552-6d03-49a2-8396-696f91443c82 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:23.736838 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f9116552-6d03-49a2-8396-696f91443c82 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:23.737607 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f9116552-6d03-49a2-8396-696f91443c82 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:23.738036 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f9116552-6d03-49a2-8396-696f91443c82 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:23.857779 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-f9116552-6d03-49a2-8396-696f91443c82 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fec41eb8ba14082b33f628c86fe48c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874042788a343ec976046e4394fa45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:02:23.865134 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-f9116552-6d03-49a2-8396-696f91443c82 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] 10.222.0.35 "GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743" status: 200 len: 1575 microversion: 2.1 time: 0.139431 Aug 07 05:02:23.865682 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 500/1041] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:02:23 2021] GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743 => generated 1575 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:02:23.952986 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-70aa218e-02a5-4284-9bff-3ad4ee83fa8d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:02:23.953942 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-70aa218e-02a5-4284-9bff-3ad4ee83fa8d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:23.960664 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-70aa218e-02a5-4284-9bff-3ad4ee83fa8d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:23.961153 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-70aa218e-02a5-4284-9bff-3ad4ee83fa8d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:23.961929 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-70aa218e-02a5-4284-9bff-3ad4ee83fa8d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:23.962372 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-70aa218e-02a5-4284-9bff-3ad4ee83fa8d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:24.046328 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-70aa218e-02a5-4284-9bff-3ad4ee83fa8d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 28687 microversion: 2.20 time: 0.097842 Aug 07 05:02:24.047165 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 542/1042] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:02:23 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 28687 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:02:24.881863 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-24b4a211-b4a6-4490-82df-3c890e780eec tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:02:24.882406 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-24b4a211-b4a6-4490-82df-3c890e780eec tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] [instance: c0921101-facb-43a4-addf-1c9791448743] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:24.888244 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-24b4a211-b4a6-4490-82df-3c890e780eec tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:24.888691 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-24b4a211-b4a6-4490-82df-3c890e780eec tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:24.889487 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-24b4a211-b4a6-4490-82df-3c890e780eec tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:24.890007 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-24b4a211-b4a6-4490-82df-3c890e780eec tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:25.010880 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-24b4a211-b4a6-4490-82df-3c890e780eec tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fec41eb8ba14082b33f628c86fe48c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874042788a343ec976046e4394fa45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:02:25.018249 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-24b4a211-b4a6-4490-82df-3c890e780eec tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] 10.222.0.35 "GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743" status: 200 len: 1575 microversion: 2.1 time: 0.140166 Aug 07 05:02:25.018815 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 501/1043] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:02:24 2021] GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743 => generated 1575 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:02:25.058391 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-41d67e37-25ff-4e59-bb66-e23a850955e2 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:02:25.059380 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-41d67e37-25ff-4e59-bb66-e23a850955e2 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:25.065976 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-41d67e37-25ff-4e59-bb66-e23a850955e2 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:25.066420 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-41d67e37-25ff-4e59-bb66-e23a850955e2 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:25.067175 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-41d67e37-25ff-4e59-bb66-e23a850955e2 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:25.067599 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-41d67e37-25ff-4e59-bb66-e23a850955e2 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:25.150174 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-41d67e37-25ff-4e59-bb66-e23a850955e2 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 28687 microversion: 2.20 time: 0.095532 Aug 07 05:02:25.150749 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 543/1044] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:02:25 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 28687 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:02:26.035604 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-7e3ab636-4779-4c21-8f18-a83aa0cca239 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:02:26.036230 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-7e3ab636-4779-4c21-8f18-a83aa0cca239 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] [instance: c0921101-facb-43a4-addf-1c9791448743] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:26.042320 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7e3ab636-4779-4c21-8f18-a83aa0cca239 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:26.042767 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7e3ab636-4779-4c21-8f18-a83aa0cca239 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:26.043527 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7e3ab636-4779-4c21-8f18-a83aa0cca239 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:26.043954 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7e3ab636-4779-4c21-8f18-a83aa0cca239 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:26.162511 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-d24fea5c-47d6-4b3d-a3c7-4e0c820d6357 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:02:26.163523 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-d24fea5c-47d6-4b3d-a3c7-4e0c820d6357 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:26.163867 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-7e3ab636-4779-4c21-8f18-a83aa0cca239 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fec41eb8ba14082b33f628c86fe48c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874042788a343ec976046e4394fa45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:02:26.170201 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d24fea5c-47d6-4b3d-a3c7-4e0c820d6357 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:26.170648 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d24fea5c-47d6-4b3d-a3c7-4e0c820d6357 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:26.171796 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-7e3ab636-4779-4c21-8f18-a83aa0cca239 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] 10.222.0.35 "GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743" status: 200 len: 1575 microversion: 2.1 time: 0.139329 Aug 07 05:02:26.172182 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d24fea5c-47d6-4b3d-a3c7-4e0c820d6357 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:26.177126 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 502/1045] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:02:26 2021] GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743 => generated 1575 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:02:26.177303 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d24fea5c-47d6-4b3d-a3c7-4e0c820d6357 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:26.256119 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-d24fea5c-47d6-4b3d-a3c7-4e0c820d6357 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 28687 microversion: 2.20 time: 0.097769 Aug 07 05:02:26.256781 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 544/1046] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:02:26 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 28687 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 07 05:02:27.189120 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-72f562d3-fb46-4869-a17b-7517194e546c tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:02:27.189730 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-72f562d3-fb46-4869-a17b-7517194e546c tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] [instance: c0921101-facb-43a4-addf-1c9791448743] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:27.195595 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-72f562d3-fb46-4869-a17b-7517194e546c tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:27.196039 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-72f562d3-fb46-4869-a17b-7517194e546c tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:27.197011 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-72f562d3-fb46-4869-a17b-7517194e546c tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:27.197273 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-72f562d3-fb46-4869-a17b-7517194e546c tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:27.269872 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-c2db3d05-7ab8-4c43-8e77-e6cdcf475b42 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:02:27.270794 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-c2db3d05-7ab8-4c43-8e77-e6cdcf475b42 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:27.277393 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c2db3d05-7ab8-4c43-8e77-e6cdcf475b42 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:27.277934 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c2db3d05-7ab8-4c43-8e77-e6cdcf475b42 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:27.278717 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c2db3d05-7ab8-4c43-8e77-e6cdcf475b42 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:27.279152 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c2db3d05-7ab8-4c43-8e77-e6cdcf475b42 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:27.320729 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-72f562d3-fb46-4869-a17b-7517194e546c tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fec41eb8ba14082b33f628c86fe48c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874042788a343ec976046e4394fa45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:02:27.328735 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-72f562d3-fb46-4869-a17b-7517194e546c tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] 10.222.0.35 "GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743" status: 200 len: 1575 microversion: 2.1 time: 0.143853 Aug 07 05:02:27.329312 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 503/1047] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:02:27 2021] GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743 => generated 1575 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:02:27.374479 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-c2db3d05-7ab8-4c43-8e77-e6cdcf475b42 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 28687 microversion: 2.20 time: 0.110321 Aug 07 05:02:27.375149 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 545/1048] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:02:27 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 28687 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 07 05:02:28.347034 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-f9602abf-ad49-400e-8699-3e1e423af7ff tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:02:28.347642 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-f9602abf-ad49-400e-8699-3e1e423af7ff tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] [instance: c0921101-facb-43a4-addf-1c9791448743] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:28.353436 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f9602abf-ad49-400e-8699-3e1e423af7ff tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:28.353891 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f9602abf-ad49-400e-8699-3e1e423af7ff tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:28.354654 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f9602abf-ad49-400e-8699-3e1e423af7ff tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:28.355090 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f9602abf-ad49-400e-8699-3e1e423af7ff tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:28.387741 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-b36b1c6b-ff42-4e6e-bbf4-30c9a607efbc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:02:28.388977 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-b36b1c6b-ff42-4e6e-bbf4-30c9a607efbc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:28.396219 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b36b1c6b-ff42-4e6e-bbf4-30c9a607efbc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:28.396670 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b36b1c6b-ff42-4e6e-bbf4-30c9a607efbc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:28.398149 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b36b1c6b-ff42-4e6e-bbf4-30c9a607efbc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:28.398641 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b36b1c6b-ff42-4e6e-bbf4-30c9a607efbc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:28.488576 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-b36b1c6b-ff42-4e6e-bbf4-30c9a607efbc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 28687 microversion: 2.20 time: 0.105267 Aug 07 05:02:28.492911 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 546/1049] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:02:28 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 28687 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 07 05:02:28.526007 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-f9602abf-ad49-400e-8699-3e1e423af7ff tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fec41eb8ba14082b33f628c86fe48c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874042788a343ec976046e4394fa45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:02:28.533976 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-f9602abf-ad49-400e-8699-3e1e423af7ff tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] 10.222.0.35 "GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743" status: 200 len: 1575 microversion: 2.1 time: 0.191490 Aug 07 05:02:28.534549 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 504/1050] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:02:28 2021] GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743 => generated 1575 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:02:29.502046 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-d05b43a2-ecc4-4b44-b3b5-ae651335ffea tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:02:29.503028 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-d05b43a2-ecc4-4b44-b3b5-ae651335ffea tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:29.509447 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d05b43a2-ecc4-4b44-b3b5-ae651335ffea tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:29.509883 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d05b43a2-ecc4-4b44-b3b5-ae651335ffea tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:29.510644 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d05b43a2-ecc4-4b44-b3b5-ae651335ffea tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:29.511067 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d05b43a2-ecc4-4b44-b3b5-ae651335ffea tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:29.550566 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-f9ec7d27-63a4-4c37-8992-c5a974b41906 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:02:29.551147 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-f9ec7d27-63a4-4c37-8992-c5a974b41906 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] [instance: c0921101-facb-43a4-addf-1c9791448743] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:29.556988 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f9ec7d27-63a4-4c37-8992-c5a974b41906 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:29.557430 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f9ec7d27-63a4-4c37-8992-c5a974b41906 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:29.558184 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f9ec7d27-63a4-4c37-8992-c5a974b41906 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:29.558607 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f9ec7d27-63a4-4c37-8992-c5a974b41906 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:29.612528 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-d05b43a2-ecc4-4b44-b3b5-ae651335ffea tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 28687 microversion: 2.20 time: 0.115297 Aug 07 05:02:29.616393 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 547/1051] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:02:29 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 28687 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:02:29.679265 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-f9ec7d27-63a4-4c37-8992-c5a974b41906 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fec41eb8ba14082b33f628c86fe48c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874042788a343ec976046e4394fa45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:02:29.687227 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-f9ec7d27-63a4-4c37-8992-c5a974b41906 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] 10.222.0.35 "GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743" status: 200 len: 1575 microversion: 2.1 time: 0.139515 Aug 07 05:02:29.688000 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 505/1052] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:02:29 2021] GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743 => generated 1575 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 05:02:30.626061 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-2f74e087-7a1e-49a9-a522-4a363e7dde57 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:02:30.627084 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-2f74e087-7a1e-49a9-a522-4a363e7dde57 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:30.636406 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2f74e087-7a1e-49a9-a522-4a363e7dde57 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:30.637188 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2f74e087-7a1e-49a9-a522-4a363e7dde57 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:30.640069 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2f74e087-7a1e-49a9-a522-4a363e7dde57 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:30.640531 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2f74e087-7a1e-49a9-a522-4a363e7dde57 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:30.704288 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-e79bfc9b-d6dd-41e1-92b5-eaba346f7026 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:02:30.704911 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-e79bfc9b-d6dd-41e1-92b5-eaba346f7026 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] [instance: c0921101-facb-43a4-addf-1c9791448743] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:30.711709 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e79bfc9b-d6dd-41e1-92b5-eaba346f7026 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:30.712152 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e79bfc9b-d6dd-41e1-92b5-eaba346f7026 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:30.712960 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e79bfc9b-d6dd-41e1-92b5-eaba346f7026 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:30.713537 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e79bfc9b-d6dd-41e1-92b5-eaba346f7026 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:30.743542 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-2f74e087-7a1e-49a9-a522-4a363e7dde57 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 28687 microversion: 2.20 time: 0.122282 Aug 07 05:02:30.744198 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 548/1053] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:02:30 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 28687 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:02:30.866525 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-e79bfc9b-d6dd-41e1-92b5-eaba346f7026 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fec41eb8ba14082b33f628c86fe48c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874042788a343ec976046e4394fa45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:02:30.874055 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-e79bfc9b-d6dd-41e1-92b5-eaba346f7026 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] 10.222.0.35 "GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743" status: 200 len: 1562 microversion: 2.1 time: 0.174035 Aug 07 05:02:30.874820 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 506/1054] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:02:30 2021] GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743 => generated 1562 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 05:02:31.755806 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-4bc78fc7-e1ab-42cf-923a-f5a266b6f10b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:02:31.756825 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-4bc78fc7-e1ab-42cf-923a-f5a266b6f10b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:31.763308 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4bc78fc7-e1ab-42cf-923a-f5a266b6f10b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:31.763759 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4bc78fc7-e1ab-42cf-923a-f5a266b6f10b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:31.764893 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4bc78fc7-e1ab-42cf-923a-f5a266b6f10b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:31.765305 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4bc78fc7-e1ab-42cf-923a-f5a266b6f10b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:31.880281 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-4bc78fc7-e1ab-42cf-923a-f5a266b6f10b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 28687 microversion: 2.20 time: 0.128388 Aug 07 05:02:31.880947 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 549/1055] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:02:31 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 28687 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:02:32.445460 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [req-03834985-8d47-4ebb-b54f-04d97e136003 req-900c5727-f765-4727-b7d5-cef44a4228e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0921101-facb-43a4-addf-1c9791448743", "name": "network-vif-plugged", "status": "completed", "tag": "018d5d66-f848-4b34-9a5e-9f813a6e1b80"}]} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:02:32.447419 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 05:02:32.447419 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: warnings.warn(msg) Aug 07 05:02:32.456505 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-03834985-8d47-4ebb-b54f-04d97e136003 req-900c5727-f765-4727-b7d5-cef44a4228e8 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:32.456978 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-03834985-8d47-4ebb-b54f-04d97e136003 req-900c5727-f765-4727-b7d5-cef44a4228e8 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:32.470033 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.compute.server_external_events [req-03834985-8d47-4ebb-b54f-04d97e136003 req-900c5727-f765-4727-b7d5-cef44a4228e8 service nova] Creating event network-vif-plugged:018d5d66-f848-4b34-9a5e-9f813a6e1b80 for instance c0921101-facb-43a4-addf-1c9791448743 on hv-cinder-80374 Aug 07 05:02:32.474895 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [req-03834985-8d47-4ebb-b54f-04d97e136003 req-900c5727-f765-4727-b7d5-cef44a4228e8 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033088 Aug 07 05:02:32.475661 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 507/1056] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 05:02:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 05:02:32.892357 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-5a96249c-7c3c-4d3b-9416-06b902cde4fa tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:02:32.893392 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-5a96249c-7c3c-4d3b-9416-06b902cde4fa tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:32.899823 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5a96249c-7c3c-4d3b-9416-06b902cde4fa tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:32.900263 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5a96249c-7c3c-4d3b-9416-06b902cde4fa tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:32.901050 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5a96249c-7c3c-4d3b-9416-06b902cde4fa tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:32.901479 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5a96249c-7c3c-4d3b-9416-06b902cde4fa tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:32.997191 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-5a96249c-7c3c-4d3b-9416-06b902cde4fa tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 28687 microversion: 2.20 time: 0.108879 Aug 07 05:02:32.998049 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 550/1057] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:02:32 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 28687 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:02:34.008945 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-fb35f991-0cb3-483e-9349-ff2e7b1481ca tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:02:34.009842 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-fb35f991-0cb3-483e-9349-ff2e7b1481ca tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:34.016103 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-fb35f991-0cb3-483e-9349-ff2e7b1481ca tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:34.016549 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-fb35f991-0cb3-483e-9349-ff2e7b1481ca tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:34.017344 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-fb35f991-0cb3-483e-9349-ff2e7b1481ca tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:34.017777 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-fb35f991-0cb3-483e-9349-ff2e7b1481ca tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:34.102013 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-fb35f991-0cb3-483e-9349-ff2e7b1481ca tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 28687 microversion: 2.20 time: 0.097004 Aug 07 05:02:34.102643 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 508/1058] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:02:34 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 28687 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:02:35.114790 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-967827d4-ed32-4ca4-bcf9-9f2494f59b02 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:02:35.115787 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-967827d4-ed32-4ca4-bcf9-9f2494f59b02 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:35.122286 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-967827d4-ed32-4ca4-bcf9-9f2494f59b02 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:35.122732 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-967827d4-ed32-4ca4-bcf9-9f2494f59b02 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:35.123493 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-967827d4-ed32-4ca4-bcf9-9f2494f59b02 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:35.124752 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-967827d4-ed32-4ca4-bcf9-9f2494f59b02 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:35.205439 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-967827d4-ed32-4ca4-bcf9-9f2494f59b02 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 28687 microversion: 2.20 time: 0.094514 Aug 07 05:02:35.206305 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 551/1059] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:02:35 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 28687 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:02:36.217954 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-d786d12d-c90d-4631-a649-5f1ef5d2894c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:02:36.218939 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-d786d12d-c90d-4631-a649-5f1ef5d2894c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:36.225373 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d786d12d-c90d-4631-a649-5f1ef5d2894c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:36.225817 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d786d12d-c90d-4631-a649-5f1ef5d2894c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:36.226581 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d786d12d-c90d-4631-a649-5f1ef5d2894c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:36.227013 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d786d12d-c90d-4631-a649-5f1ef5d2894c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:36.313568 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-d786d12d-c90d-4631-a649-5f1ef5d2894c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 28687 microversion: 2.20 time: 0.099790 Aug 07 05:02:36.314182 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 509/1060] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:02:36 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 28687 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:02:37.324710 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-8991dfd6-e64b-4728-b717-6ad3b627c90f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:02:37.325735 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-8991dfd6-e64b-4728-b717-6ad3b627c90f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:37.333091 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8991dfd6-e64b-4728-b717-6ad3b627c90f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:37.333993 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8991dfd6-e64b-4728-b717-6ad3b627c90f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:37.334292 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8991dfd6-e64b-4728-b717-6ad3b627c90f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:37.334722 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8991dfd6-e64b-4728-b717-6ad3b627c90f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:37.438305 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-8991dfd6-e64b-4728-b717-6ad3b627c90f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 30388 microversion: 2.20 time: 0.117573 Aug 07 05:02:37.438919 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 552/1061] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:02:37 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 30388 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 07 05:02:38.451016 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-ed8508bf-815f-4bed-b7c5-c79a4b0926d5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:02:38.452131 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-ed8508bf-815f-4bed-b7c5-c79a4b0926d5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:38.458874 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ed8508bf-815f-4bed-b7c5-c79a4b0926d5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:38.459316 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ed8508bf-815f-4bed-b7c5-c79a4b0926d5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:38.460068 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ed8508bf-815f-4bed-b7c5-c79a4b0926d5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:38.460496 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ed8508bf-815f-4bed-b7c5-c79a4b0926d5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:38.561258 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-ed8508bf-815f-4bed-b7c5-c79a4b0926d5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 32422 microversion: 2.20 time: 0.114677 Aug 07 05:02:38.561999 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 510/1062] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:02:38 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 32422 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:02:39.574076 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-5814399c-fd9e-4260-8fb3-ccf4be762c38 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:02:39.575065 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-5814399c-fd9e-4260-8fb3-ccf4be762c38 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:39.582084 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5814399c-fd9e-4260-8fb3-ccf4be762c38 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:39.582525 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5814399c-fd9e-4260-8fb3-ccf4be762c38 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:39.583646 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5814399c-fd9e-4260-8fb3-ccf4be762c38 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:39.584073 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5814399c-fd9e-4260-8fb3-ccf4be762c38 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:39.689901 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-5814399c-fd9e-4260-8fb3-ccf4be762c38 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 33480 microversion: 2.20 time: 0.120124 Aug 07 05:02:39.690577 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 553/1063] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:02:39 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 33480 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:02:40.702294 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-12574e3f-3c66-431c-87a7-a3b129b6e75a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:02:40.703334 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-12574e3f-3c66-431c-87a7-a3b129b6e75a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:40.710107 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-12574e3f-3c66-431c-87a7-a3b129b6e75a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:40.710554 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-12574e3f-3c66-431c-87a7-a3b129b6e75a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:40.711323 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-12574e3f-3c66-431c-87a7-a3b129b6e75a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:40.711762 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-12574e3f-3c66-431c-87a7-a3b129b6e75a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:40.806425 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-12574e3f-3c66-431c-87a7-a3b129b6e75a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 34562 microversion: 2.20 time: 0.108281 Aug 07 05:02:40.807048 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 511/1064] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:02:40 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 34562 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:02:41.818565 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-2c24ca2c-e60d-4d4b-be00-31a89be84b32 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:02:41.819554 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-2c24ca2c-e60d-4d4b-be00-31a89be84b32 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:41.826000 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2c24ca2c-e60d-4d4b-be00-31a89be84b32 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:41.826781 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2c24ca2c-e60d-4d4b-be00-31a89be84b32 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:41.827771 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2c24ca2c-e60d-4d4b-be00-31a89be84b32 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:41.828206 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2c24ca2c-e60d-4d4b-be00-31a89be84b32 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:41.925406 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-2c24ca2c-e60d-4d4b-be00-31a89be84b32 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 35583 microversion: 2.20 time: 0.110605 Aug 07 05:02:41.925983 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 554/1065] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:02:41 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 35583 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:02:42.938238 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-f024ff62-4791-488a-ac14-d0b943a5d06d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:02:42.939131 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-f024ff62-4791-488a-ac14-d0b943a5d06d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:42.945627 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f024ff62-4791-488a-ac14-d0b943a5d06d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:42.946066 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f024ff62-4791-488a-ac14-d0b943a5d06d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:42.946818 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f024ff62-4791-488a-ac14-d0b943a5d06d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:42.947246 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f024ff62-4791-488a-ac14-d0b943a5d06d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:45.769359 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-f024ff62-4791-488a-ac14-d0b943a5d06d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 38158 microversion: 2.20 time: 2.835649 Aug 07 05:02:45.770053 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 512/1066] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:02:42 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 38158 bytes in 2837 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:02:46.781509 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-6181b2c8-891a-433b-abe4-145f4f613125 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:02:46.782502 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-6181b2c8-891a-433b-abe4-145f4f613125 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:46.789008 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6181b2c8-891a-433b-abe4-145f4f613125 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:46.789452 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6181b2c8-891a-433b-abe4-145f4f613125 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:46.790218 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6181b2c8-891a-433b-abe4-145f4f613125 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:46.790637 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6181b2c8-891a-433b-abe4-145f4f613125 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:46.884148 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-6181b2c8-891a-433b-abe4-145f4f613125 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 38228 microversion: 2.20 time: 0.106578 Aug 07 05:02:46.888356 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 555/1067] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:02:46 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 38228 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:02:47.896518 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-5674e509-86a8-425a-80f8-5a41c675ed78 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:02:47.897469 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-5674e509-86a8-425a-80f8-5a41c675ed78 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:47.904128 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5674e509-86a8-425a-80f8-5a41c675ed78 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:47.905878 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5674e509-86a8-425a-80f8-5a41c675ed78 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:47.906748 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5674e509-86a8-425a-80f8-5a41c675ed78 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:47.906748 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5674e509-86a8-425a-80f8-5a41c675ed78 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:48.000341 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-5674e509-86a8-425a-80f8-5a41c675ed78 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 38228 microversion: 2.20 time: 0.107821 Aug 07 05:02:48.000981 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 513/1068] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:02:47 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 38228 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:02:49.012621 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-40e158fa-9e5c-4718-ab05-ec4863fc6875 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:02:49.014428 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-40e158fa-9e5c-4718-ab05-ec4863fc6875 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:49.020897 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-40e158fa-9e5c-4718-ab05-ec4863fc6875 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:49.021339 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-40e158fa-9e5c-4718-ab05-ec4863fc6875 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:49.022102 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-40e158fa-9e5c-4718-ab05-ec4863fc6875 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:49.022529 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-40e158fa-9e5c-4718-ab05-ec4863fc6875 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:49.124622 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-40e158fa-9e5c-4718-ab05-ec4863fc6875 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 200 len: 38367 microversion: 2.20 time: 0.116076 Aug 07 05:02:49.125296 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 556/1069] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:02:49 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 38367 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:02:49.135466 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-f07a7e46-5476-4a6b-b4e9-03199a71e215 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:02:49.136043 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-f07a7e46-5476-4a6b-b4e9-03199a71e215 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:49.142968 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f07a7e46-5476-4a6b-b4e9-03199a71e215 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:49.143413 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f07a7e46-5476-4a6b-b4e9-03199a71e215 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:49.144177 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f07a7e46-5476-4a6b-b4e9-03199a71e215 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:49.144609 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f07a7e46-5476-4a6b-b4e9-03199a71e215 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:49.167115 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-f07a7e46-5476-4a6b-b4e9-03199a71e215 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/ips" status: 200 len: 152 microversion: 2.20 time: 0.035766 Aug 07 05:02:49.167663 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 514/1070] 10.222.0.35 () {60 vars in 1289 bytes} [Sat Aug 7 05:02:49 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/ips => generated 152 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:02:53.550426 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-1e2cef8e-e505-4327-9c1a-a7e1bfe89e81 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-778930284", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1125723205", "security_groups": [{"name": "tempest-secgroup-smoke-428334738"}], "block_device_mapping_v2": [{"uuid": "01373347-5874-4d84-951e-19d4df35b381", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b97eba61-232f-41ac-a37d-dd36ec699f72"}]}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:02:53.656032 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.network.neutron [None req-1e2cef8e-e505-4327-9c1a-a7e1bfe89e81 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] validate_networks() for [('b97eba61-232f-41ac-a37d-dd36ec699f72', None, None, None)] {{(pid=107486) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 07 05:02:54.020618 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.virt.hardware [None req-1e2cef8e-e505-4327-9c1a-a7e1bfe89e81 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Flavor limits 0:0:0 {{(pid=107486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 05:02:54.021087 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.virt.hardware [None req-1e2cef8e-e505-4327-9c1a-a7e1bfe89e81 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Image limits 0:0:0 {{(pid=107486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 05:02:54.021562 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.virt.hardware [None req-1e2cef8e-e505-4327-9c1a-a7e1bfe89e81 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Flavor pref 0:0:0 {{(pid=107486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 05:02:54.021970 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.virt.hardware [None req-1e2cef8e-e505-4327-9c1a-a7e1bfe89e81 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Image pref 0:0:0 {{(pid=107486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 05:02:54.022380 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.virt.hardware [None req-1e2cef8e-e505-4327-9c1a-a7e1bfe89e81 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 05:02:54.031026 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1e2cef8e-e505-4327-9c1a-a7e1bfe89e81 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:54.031465 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1e2cef8e-e505-4327-9c1a-a7e1bfe89e81 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:54.032261 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1e2cef8e-e505-4327-9c1a-a7e1bfe89e81 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:54.032694 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1e2cef8e-e505-4327-9c1a-a7e1bfe89e81 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:54.048598 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.quota [None req-1e2cef8e-e505-4327-9c1a-a7e1bfe89e81 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Getting quotas for project e90cab30a20644dbabb505e1ada2dc3a. Resources: {'ram', 'cores', 'instances'} {{(pid=107486) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 07 05:02:54.052448 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.quota [None req-1e2cef8e-e505-4327-9c1a-a7e1bfe89e81 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Getting quotas for user 1c71b131fcdb495d829a615ebae65aaa and project e90cab30a20644dbabb505e1ada2dc3a. Resources: {'ram', 'cores', 'instances'} {{(pid=107486) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 07 05:02:54.111766 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-1e2cef8e-e505-4327-9c1a-a7e1bfe89e81 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Going to run 1 instances... {{(pid=107486) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 07 05:02:54.114008 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-1e2cef8e-e505-4327-9c1a-a7e1bfe89e81 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='01373347-5874-4d84-951e-19d4df35b381',volume_size=None,volume_type=None)] {{(pid=107486) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 07 05:02:54.230901 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-1e2cef8e-e505-4327-9c1a-a7e1bfe89e81 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.684401 Aug 07 05:02:54.231545 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 557/1071] 10.222.0.35 () {60 vars in 1147 bytes} [Sat Aug 7 05:02:53 2021] POST /compute/v2.1/servers => generated 405 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 05:02:54.241575 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-3ba2549c-795d-432d-a070-475d653f238c tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:02:54.242207 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-3ba2549c-795d-432d-a070-475d653f238c tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:54.299053 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-3ba2549c-795d-432d-a070-475d653f238c tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:02:54.307649 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-3ba2549c-795d-432d-a070-475d653f238c tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17" status: 200 len: 1094 microversion: 2.1 time: 0.069819 Aug 07 05:02:54.308228 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 515/1072] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:02:54 2021] GET /compute/v2.1/servers/5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17 => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:02:54.790822 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-6757e660-8a20-4af9-abe4-29a20b8257e5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:02:54.791406 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-6757e660-8a20-4af9-abe4-29a20b8257e5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:54.798367 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6757e660-8a20-4af9-abe4-29a20b8257e5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:54.798740 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6757e660-8a20-4af9-abe4-29a20b8257e5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:54.799510 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6757e660-8a20-4af9-abe4-29a20b8257e5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:54.799940 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6757e660-8a20-4af9-abe4-29a20b8257e5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:54.822846 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.objects.instance [None req-6757e660-8a20-4af9-abe4-29a20b8257e5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lazy-loading 'flavor' on Instance uuid c28c4450-6a8b-4d0b-b175-29ed3a3b148c {{(pid=107486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 05:02:55.075200 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-6757e660-8a20-4af9-abe4-29a20b8257e5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 202 len: 0 microversion: 2.20 time: 0.288859 Aug 07 05:02:55.076654 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 558/1073] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:02:54 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 07 05:02:55.084923 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-7466ca15-1d48-4ec2-8d0b-22d4f0cb128e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:02:55.085656 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-7466ca15-1d48-4ec2-8d0b-22d4f0cb128e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:55.092300 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7466ca15-1d48-4ec2-8d0b-22d4f0cb128e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:55.092753 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7466ca15-1d48-4ec2-8d0b-22d4f0cb128e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:55.093553 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7466ca15-1d48-4ec2-8d0b-22d4f0cb128e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:55.093991 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7466ca15-1d48-4ec2-8d0b-22d4f0cb128e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:55.217730 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-7466ca15-1d48-4ec2-8d0b-22d4f0cb128e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:02:55.225483 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-7466ca15-1d48-4ec2-8d0b-22d4f0cb128e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:02:55.226965 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-7466ca15-1d48-4ec2-8d0b-22d4f0cb128e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:02:55.228079 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-7466ca15-1d48-4ec2-8d0b-22d4f0cb128e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1721 microversion: 2.20 time: 0.147246 Aug 07 05:02:55.228690 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 516/1074] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:02:55 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1721 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 05:02:55.326691 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-fa4b5496-2ccf-4b72-91a0-92b085322912 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:02:55.326691 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-fa4b5496-2ccf-4b72-91a0-92b085322912 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:55.332947 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-fa4b5496-2ccf-4b72-91a0-92b085322912 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:55.333390 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-fa4b5496-2ccf-4b72-91a0-92b085322912 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:55.334162 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-fa4b5496-2ccf-4b72-91a0-92b085322912 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:55.334598 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-fa4b5496-2ccf-4b72-91a0-92b085322912 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:55.398676 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-fa4b5496-2ccf-4b72-91a0-92b085322912 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:02:55.406732 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-fa4b5496-2ccf-4b72-91a0-92b085322912 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17" status: 200 len: 1210 microversion: 2.1 time: 0.085233 Aug 07 05:02:55.407341 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 559/1075] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:02:55 2021] GET /compute/v2.1/servers/5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17 => generated 1210 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:02:56.247093 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-e5fbe3dd-cad9-4b8b-8dff-8499a2d24908 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:02:56.248198 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-e5fbe3dd-cad9-4b8b-8dff-8499a2d24908 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:56.255011 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e5fbe3dd-cad9-4b8b-8dff-8499a2d24908 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:56.255451 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e5fbe3dd-cad9-4b8b-8dff-8499a2d24908 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:56.256228 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e5fbe3dd-cad9-4b8b-8dff-8499a2d24908 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:56.256656 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e5fbe3dd-cad9-4b8b-8dff-8499a2d24908 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:56.423772 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-f0f364cc-e6c4-4ba6-a469-9cc0c55e7854 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:02:56.424432 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-f0f364cc-e6c4-4ba6-a469-9cc0c55e7854 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:56.430068 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f0f364cc-e6c4-4ba6-a469-9cc0c55e7854 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:56.430510 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f0f364cc-e6c4-4ba6-a469-9cc0c55e7854 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:56.431521 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f0f364cc-e6c4-4ba6-a469-9cc0c55e7854 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:56.431965 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f0f364cc-e6c4-4ba6-a469-9cc0c55e7854 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:56.450416 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-e5fbe3dd-cad9-4b8b-8dff-8499a2d24908 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:02:56.461082 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-e5fbe3dd-cad9-4b8b-8dff-8499a2d24908 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:02:56.462810 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-e5fbe3dd-cad9-4b8b-8dff-8499a2d24908 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:02:56.464279 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-e5fbe3dd-cad9-4b8b-8dff-8499a2d24908 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1721 microversion: 2.20 time: 0.220972 Aug 07 05:02:56.464991 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 517/1076] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:02:56 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1721 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 05:02:56.577632 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-f0f364cc-e6c4-4ba6-a469-9cc0c55e7854 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:02:56.585456 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-f0f364cc-e6c4-4ba6-a469-9cc0c55e7854 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17" status: 200 len: 1265 microversion: 2.1 time: 0.165456 Aug 07 05:02:56.588021 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 560/1077] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:02:56 2021] GET /compute/v2.1/servers/5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 05:02:56.729303 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [req-7f72f1b1-ca33-4438-afe0-40aaed152319 req-ef2e9f83-3273-4a2a-9558-82f061e4f7f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17", "tag": "ce9c023e-3f65-4600-938f-4bbbb114a9b9"}]} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:02:56.731065 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 05:02:56.731065 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: warnings.warn(msg) Aug 07 05:02:56.739749 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-7f72f1b1-ca33-4438-afe0-40aaed152319 req-ef2e9f83-3273-4a2a-9558-82f061e4f7f5 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:56.741154 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-7f72f1b1-ca33-4438-afe0-40aaed152319 req-ef2e9f83-3273-4a2a-9558-82f061e4f7f5 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:56.756290 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.compute.server_external_events [req-7f72f1b1-ca33-4438-afe0-40aaed152319 req-ef2e9f83-3273-4a2a-9558-82f061e4f7f5 service nova] Creating event network-changed:ce9c023e-3f65-4600-938f-4bbbb114a9b9 for instance 5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17 on hv-cinder-80374 Aug 07 05:02:56.761335 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [req-7f72f1b1-ca33-4438-afe0-40aaed152319 req-ef2e9f83-3273-4a2a-9558-82f061e4f7f5 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036289 Aug 07 05:02:56.762041 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 518/1078] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 05:02:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 05:02:57.483650 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-3e19db50-de96-496d-8def-658979cf7496 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:02:57.484257 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-3e19db50-de96-496d-8def-658979cf7496 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:57.490894 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3e19db50-de96-496d-8def-658979cf7496 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:57.491271 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3e19db50-de96-496d-8def-658979cf7496 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:57.492034 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3e19db50-de96-496d-8def-658979cf7496 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:57.492466 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3e19db50-de96-496d-8def-658979cf7496 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:57.603507 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-4d15c09e-e28e-4243-9448-33af32091459 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:02:57.604206 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-4d15c09e-e28e-4243-9448-33af32091459 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:57.610403 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4d15c09e-e28e-4243-9448-33af32091459 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:57.611157 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4d15c09e-e28e-4243-9448-33af32091459 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:57.612147 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4d15c09e-e28e-4243-9448-33af32091459 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:57.612585 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4d15c09e-e28e-4243-9448-33af32091459 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:57.634606 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-3e19db50-de96-496d-8def-658979cf7496 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:02:57.644286 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-3e19db50-de96-496d-8def-658979cf7496 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:02:57.646186 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-3e19db50-de96-496d-8def-658979cf7496 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:02:57.647408 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-3e19db50-de96-496d-8def-658979cf7496 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1721 microversion: 2.20 time: 0.167791 Aug 07 05:02:57.648083 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 561/1079] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:02:57 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 05:02:57.812923 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-4d15c09e-e28e-4243-9448-33af32091459 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:02:57.820296 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-4d15c09e-e28e-4243-9448-33af32091459 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17" status: 200 len: 1265 microversion: 2.1 time: 0.220927 Aug 07 05:02:57.821093 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 519/1080] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:02:57 2021] GET /compute/v2.1/servers/5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17 => generated 1265 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 05:02:58.666069 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-d462f403-deed-4996-ac50-d3b771eb8a1d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:02:58.666697 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-d462f403-deed-4996-ac50-d3b771eb8a1d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:58.673287 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d462f403-deed-4996-ac50-d3b771eb8a1d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:58.673726 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d462f403-deed-4996-ac50-d3b771eb8a1d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:58.674479 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d462f403-deed-4996-ac50-d3b771eb8a1d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:58.674903 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d462f403-deed-4996-ac50-d3b771eb8a1d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:58.791439 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-d462f403-deed-4996-ac50-d3b771eb8a1d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:02:58.799852 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-d462f403-deed-4996-ac50-d3b771eb8a1d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:02:58.801367 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-d462f403-deed-4996-ac50-d3b771eb8a1d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:02:58.802501 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-d462f403-deed-4996-ac50-d3b771eb8a1d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1721 microversion: 2.20 time: 0.140136 Aug 07 05:02:58.803274 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 562/1081] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:02:58 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1721 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 05:02:58.837768 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-2ededd9e-c6e9-41b8-a6ff-b95a805a1148 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:02:58.838396 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-2ededd9e-c6e9-41b8-a6ff-b95a805a1148 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:58.845296 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2ededd9e-c6e9-41b8-a6ff-b95a805a1148 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:58.845737 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2ededd9e-c6e9-41b8-a6ff-b95a805a1148 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:58.846504 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2ededd9e-c6e9-41b8-a6ff-b95a805a1148 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:58.846930 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2ededd9e-c6e9-41b8-a6ff-b95a805a1148 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:58.972456 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-2ededd9e-c6e9-41b8-a6ff-b95a805a1148 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:02:58.979730 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-2ededd9e-c6e9-41b8-a6ff-b95a805a1148 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17" status: 200 len: 1265 microversion: 2.1 time: 0.145610 Aug 07 05:02:58.980286 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 520/1082] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:02:58 2021] GET /compute/v2.1/servers/5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17 => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:02:59.820416 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-74087389-14dc-41cc-a533-900fc80d5f82 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:02:59.821045 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-74087389-14dc-41cc-a533-900fc80d5f82 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:02:59.827042 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-74087389-14dc-41cc-a533-900fc80d5f82 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:59.827491 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-74087389-14dc-41cc-a533-900fc80d5f82 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:59.828261 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-74087389-14dc-41cc-a533-900fc80d5f82 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:02:59.828700 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-74087389-14dc-41cc-a533-900fc80d5f82 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:02:59.956004 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-74087389-14dc-41cc-a533-900fc80d5f82 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:02:59.963974 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-74087389-14dc-41cc-a533-900fc80d5f82 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:02:59.965489 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-74087389-14dc-41cc-a533-900fc80d5f82 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:02:59.967643 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-74087389-14dc-41cc-a533-900fc80d5f82 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1721 microversion: 2.20 time: 0.150997 Aug 07 05:02:59.968197 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 563/1083] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:02:59 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 05:02:59.995962 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-ad506455-a4da-4efa-a06a-b0d0b099f3f6 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:02:59.996643 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-ad506455-a4da-4efa-a06a-b0d0b099f3f6 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:00.002647 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ad506455-a4da-4efa-a06a-b0d0b099f3f6 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:00.003089 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ad506455-a4da-4efa-a06a-b0d0b099f3f6 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:00.003847 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ad506455-a4da-4efa-a06a-b0d0b099f3f6 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:00.004275 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ad506455-a4da-4efa-a06a-b0d0b099f3f6 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:00.121372 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-ad506455-a4da-4efa-a06a-b0d0b099f3f6 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:00.128655 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-ad506455-a4da-4efa-a06a-b0d0b099f3f6 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17" status: 200 len: 1265 microversion: 2.1 time: 0.136285 Aug 07 05:03:00.129248 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 521/1084] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:02:59 2021] GET /compute/v2.1/servers/5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17 => generated 1265 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:03:00.986249 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-764f27e1-ee82-421e-ac71-ee59f804564c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:03:00.986847 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-764f27e1-ee82-421e-ac71-ee59f804564c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:00.992551 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-764f27e1-ee82-421e-ac71-ee59f804564c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:00.993019 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-764f27e1-ee82-421e-ac71-ee59f804564c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:00.993776 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-764f27e1-ee82-421e-ac71-ee59f804564c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:00.994202 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-764f27e1-ee82-421e-ac71-ee59f804564c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:01.115486 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-764f27e1-ee82-421e-ac71-ee59f804564c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:01.123988 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-764f27e1-ee82-421e-ac71-ee59f804564c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:01.125481 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-764f27e1-ee82-421e-ac71-ee59f804564c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:01.126606 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-764f27e1-ee82-421e-ac71-ee59f804564c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1721 microversion: 2.20 time: 0.144942 Aug 07 05:03:01.127155 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 564/1085] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:03:00 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1721 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 05:03:01.144935 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-fca16610-c238-4c60-9491-72dd64554abc tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:03:01.145548 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-fca16610-c238-4c60-9491-72dd64554abc tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:01.151744 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-fca16610-c238-4c60-9491-72dd64554abc tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:01.152185 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-fca16610-c238-4c60-9491-72dd64554abc tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:01.152979 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-fca16610-c238-4c60-9491-72dd64554abc tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:01.153411 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-fca16610-c238-4c60-9491-72dd64554abc tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:01.273628 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-fca16610-c238-4c60-9491-72dd64554abc tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:01.281348 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-fca16610-c238-4c60-9491-72dd64554abc tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17" status: 200 len: 1265 microversion: 2.1 time: 0.140139 Aug 07 05:03:01.281902 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 522/1086] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:03:01 2021] GET /compute/v2.1/servers/5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17 => generated 1265 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:03:02.144109 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-c9a19aaf-13d7-4440-802b-9b9733e0a3b4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:03:02.144714 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-c9a19aaf-13d7-4440-802b-9b9733e0a3b4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:02.151021 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c9a19aaf-13d7-4440-802b-9b9733e0a3b4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:02.151464 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c9a19aaf-13d7-4440-802b-9b9733e0a3b4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:02.152225 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c9a19aaf-13d7-4440-802b-9b9733e0a3b4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:02.152648 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c9a19aaf-13d7-4440-802b-9b9733e0a3b4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:02.270810 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-c9a19aaf-13d7-4440-802b-9b9733e0a3b4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:02.279107 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-c9a19aaf-13d7-4440-802b-9b9733e0a3b4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:02.280537 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-c9a19aaf-13d7-4440-802b-9b9733e0a3b4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:02.281685 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-c9a19aaf-13d7-4440-802b-9b9733e0a3b4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1721 microversion: 2.20 time: 0.141336 Aug 07 05:03:02.282235 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 565/1087] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:03:02 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1721 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 05:03:02.297955 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-03e6c84d-e1a5-432d-9ec6-6b5beeb63b53 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:03:02.298558 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-03e6c84d-e1a5-432d-9ec6-6b5beeb63b53 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:02.304254 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-03e6c84d-e1a5-432d-9ec6-6b5beeb63b53 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:02.304694 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-03e6c84d-e1a5-432d-9ec6-6b5beeb63b53 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:02.305485 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-03e6c84d-e1a5-432d-9ec6-6b5beeb63b53 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:02.305917 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-03e6c84d-e1a5-432d-9ec6-6b5beeb63b53 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:02.426097 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-03e6c84d-e1a5-432d-9ec6-6b5beeb63b53 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:02.433173 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-03e6c84d-e1a5-432d-9ec6-6b5beeb63b53 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17" status: 200 len: 1265 microversion: 2.1 time: 0.139579 Aug 07 05:03:02.433722 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 523/1088] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:03:02 2021] GET /compute/v2.1/servers/5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17 => generated 1265 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:03:03.299643 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-2c766a8a-c0cb-4cd5-8105-5adf5e7ac487 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:03:03.300189 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-2c766a8a-c0cb-4cd5-8105-5adf5e7ac487 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:03.306094 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2c766a8a-c0cb-4cd5-8105-5adf5e7ac487 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:03.306539 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2c766a8a-c0cb-4cd5-8105-5adf5e7ac487 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:03.307297 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2c766a8a-c0cb-4cd5-8105-5adf5e7ac487 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:03.307726 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2c766a8a-c0cb-4cd5-8105-5adf5e7ac487 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:03.429816 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-2c766a8a-c0cb-4cd5-8105-5adf5e7ac487 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:03.438189 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-2c766a8a-c0cb-4cd5-8105-5adf5e7ac487 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:03.439652 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-2c766a8a-c0cb-4cd5-8105-5adf5e7ac487 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:03.440770 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-2c766a8a-c0cb-4cd5-8105-5adf5e7ac487 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1721 microversion: 2.20 time: 0.144974 Aug 07 05:03:03.441341 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 566/1089] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:03:03 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1721 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 05:03:03.449420 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-65f6c23c-3ce8-44a1-b5fd-552e4c14bc4c tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:03:03.450024 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-65f6c23c-3ce8-44a1-b5fd-552e4c14bc4c tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:03.455950 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-65f6c23c-3ce8-44a1-b5fd-552e4c14bc4c tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:03.456394 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-65f6c23c-3ce8-44a1-b5fd-552e4c14bc4c tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:03.457456 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-65f6c23c-3ce8-44a1-b5fd-552e4c14bc4c tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:03.457887 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-65f6c23c-3ce8-44a1-b5fd-552e4c14bc4c tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:03.575263 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-65f6c23c-3ce8-44a1-b5fd-552e4c14bc4c tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:03.582697 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-65f6c23c-3ce8-44a1-b5fd-552e4c14bc4c tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17" status: 200 len: 1265 microversion: 2.1 time: 0.136732 Aug 07 05:03:03.583267 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 524/1090] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:03:03 2021] GET /compute/v2.1/servers/5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17 => generated 1265 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:03:04.458548 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-93c8bc62-39b6-4213-9a13-cababce017b4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:03:04.459159 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-93c8bc62-39b6-4213-9a13-cababce017b4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:04.465080 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-93c8bc62-39b6-4213-9a13-cababce017b4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:04.465520 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-93c8bc62-39b6-4213-9a13-cababce017b4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:04.466319 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-93c8bc62-39b6-4213-9a13-cababce017b4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:04.466854 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-93c8bc62-39b6-4213-9a13-cababce017b4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:04.586430 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-93c8bc62-39b6-4213-9a13-cababce017b4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:04.594198 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-93c8bc62-39b6-4213-9a13-cababce017b4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:04.595677 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-93c8bc62-39b6-4213-9a13-cababce017b4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:04.596817 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-93c8bc62-39b6-4213-9a13-cababce017b4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1721 microversion: 2.20 time: 0.142241 Aug 07 05:03:04.597359 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 567/1091] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:03:04 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1721 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 05:03:04.598943 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-f7b6c2a5-dd9f-4ef0-90d2-8ea22dee7f31 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:03:04.599554 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-f7b6c2a5-dd9f-4ef0-90d2-8ea22dee7f31 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:04.605330 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f7b6c2a5-dd9f-4ef0-90d2-8ea22dee7f31 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:04.605775 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f7b6c2a5-dd9f-4ef0-90d2-8ea22dee7f31 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:04.606581 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f7b6c2a5-dd9f-4ef0-90d2-8ea22dee7f31 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:04.607017 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f7b6c2a5-dd9f-4ef0-90d2-8ea22dee7f31 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:04.724763 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-f7b6c2a5-dd9f-4ef0-90d2-8ea22dee7f31 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:04.732426 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-f7b6c2a5-dd9f-4ef0-90d2-8ea22dee7f31 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17" status: 200 len: 1265 microversion: 2.1 time: 0.136915 Aug 07 05:03:04.733019 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 525/1092] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:03:04 2021] GET /compute/v2.1/servers/5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17 => generated 1265 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 05:03:05.614815 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-e21db465-3fbf-4c18-9002-98973db85b29 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:03:05.615869 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-e21db465-3fbf-4c18-9002-98973db85b29 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:05.621267 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e21db465-3fbf-4c18-9002-98973db85b29 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:05.621707 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e21db465-3fbf-4c18-9002-98973db85b29 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:05.623051 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e21db465-3fbf-4c18-9002-98973db85b29 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:05.623477 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e21db465-3fbf-4c18-9002-98973db85b29 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:05.743003 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-e21db465-3fbf-4c18-9002-98973db85b29 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:05.749359 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-aaffee4f-ecaf-4daa-8bde-67f36bf4186e tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:03:05.749966 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-aaffee4f-ecaf-4daa-8bde-67f36bf4186e tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:05.751508 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-e21db465-3fbf-4c18-9002-98973db85b29 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:05.753011 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-e21db465-3fbf-4c18-9002-98973db85b29 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:05.754134 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-e21db465-3fbf-4c18-9002-98973db85b29 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1721 microversion: 2.20 time: 0.143080 Aug 07 05:03:05.754850 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 568/1093] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:03:05 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1721 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 05:03:05.755930 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-aaffee4f-ecaf-4daa-8bde-67f36bf4186e tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:05.756383 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-aaffee4f-ecaf-4daa-8bde-67f36bf4186e tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:05.757192 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-aaffee4f-ecaf-4daa-8bde-67f36bf4186e tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:05.757627 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-aaffee4f-ecaf-4daa-8bde-67f36bf4186e tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:05.880043 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-aaffee4f-ecaf-4daa-8bde-67f36bf4186e tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:05.887188 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-aaffee4f-ecaf-4daa-8bde-67f36bf4186e tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17" status: 200 len: 1265 microversion: 2.1 time: 0.142123 Aug 07 05:03:05.887977 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 526/1094] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:03:05 2021] GET /compute/v2.1/servers/5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17 => generated 1265 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 05:03:06.772115 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-3b8cef23-cffd-4907-b9fe-a708d3ec24af tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:03:06.772645 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-3b8cef23-cffd-4907-b9fe-a708d3ec24af tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:06.778471 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3b8cef23-cffd-4907-b9fe-a708d3ec24af tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:06.779087 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3b8cef23-cffd-4907-b9fe-a708d3ec24af tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:06.779863 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3b8cef23-cffd-4907-b9fe-a708d3ec24af tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:06.780275 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3b8cef23-cffd-4907-b9fe-a708d3ec24af tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:06.903442 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-3b8cef23-cffd-4907-b9fe-a708d3ec24af tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:06.903716 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-898ad7a4-2c35-4628-8d2e-949a41b53023 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:03:06.904504 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-898ad7a4-2c35-4628-8d2e-949a41b53023 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:06.910198 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-898ad7a4-2c35-4628-8d2e-949a41b53023 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:06.910637 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-898ad7a4-2c35-4628-8d2e-949a41b53023 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:06.911395 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-898ad7a4-2c35-4628-8d2e-949a41b53023 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:06.911501 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-3b8cef23-cffd-4907-b9fe-a708d3ec24af tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:06.911826 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-898ad7a4-2c35-4628-8d2e-949a41b53023 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:06.912969 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-3b8cef23-cffd-4907-b9fe-a708d3ec24af tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:06.914111 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-3b8cef23-cffd-4907-b9fe-a708d3ec24af tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1721 microversion: 2.20 time: 0.145868 Aug 07 05:03:06.914663 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 569/1095] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:03:06 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1721 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 05:03:07.028951 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-898ad7a4-2c35-4628-8d2e-949a41b53023 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:07.036176 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-898ad7a4-2c35-4628-8d2e-949a41b53023 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17" status: 200 len: 1265 microversion: 2.1 time: 0.136207 Aug 07 05:03:07.036739 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 527/1096] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:03:06 2021] GET /compute/v2.1/servers/5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17 => generated 1265 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 05:03:07.932049 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-c88c4f45-0702-42e5-bc0c-efb4967d2f4f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:03:07.932607 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-c88c4f45-0702-42e5-bc0c-efb4967d2f4f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:07.939013 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c88c4f45-0702-42e5-bc0c-efb4967d2f4f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:07.939452 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c88c4f45-0702-42e5-bc0c-efb4967d2f4f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:07.940202 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c88c4f45-0702-42e5-bc0c-efb4967d2f4f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:07.940627 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c88c4f45-0702-42e5-bc0c-efb4967d2f4f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:08.053390 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-b0ee8652-f466-4cba-8606-ec08cf1e6dae tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:03:08.054008 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-b0ee8652-f466-4cba-8606-ec08cf1e6dae tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:08.060485 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b0ee8652-f466-4cba-8606-ec08cf1e6dae tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:08.060999 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b0ee8652-f466-4cba-8606-ec08cf1e6dae tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:08.061789 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b0ee8652-f466-4cba-8606-ec08cf1e6dae tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:08.062229 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b0ee8652-f466-4cba-8606-ec08cf1e6dae tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:08.069659 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-c88c4f45-0702-42e5-bc0c-efb4967d2f4f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:08.077442 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-c88c4f45-0702-42e5-bc0c-efb4967d2f4f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:08.078959 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-c88c4f45-0702-42e5-bc0c-efb4967d2f4f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:08.080121 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-c88c4f45-0702-42e5-bc0c-efb4967d2f4f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1721 microversion: 2.20 time: 0.151881 Aug 07 05:03:08.080842 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 570/1097] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:03:07 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 05:03:08.182199 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-b0ee8652-f466-4cba-8606-ec08cf1e6dae tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:08.190287 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-b0ee8652-f466-4cba-8606-ec08cf1e6dae tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17" status: 200 len: 1265 microversion: 2.1 time: 0.140667 Aug 07 05:03:08.190852 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 528/1098] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:03:08 2021] GET /compute/v2.1/servers/5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17 => generated 1265 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 05:03:08.617985 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [req-ec3dc3a8-0629-4692-b5fc-b7c579a555e0 req-f9ad7d75-7b9a-4837-8806-6e43b3ebb18d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17", "name": "network-vif-plugged", "status": "completed", "tag": "ce9c023e-3f65-4600-938f-4bbbb114a9b9"}]} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:03:08.619546 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 05:03:08.619546 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: warnings.warn(msg) Aug 07 05:03:08.626746 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-ec3dc3a8-0629-4692-b5fc-b7c579a555e0 req-f9ad7d75-7b9a-4837-8806-6e43b3ebb18d service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:08.627194 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-ec3dc3a8-0629-4692-b5fc-b7c579a555e0 req-f9ad7d75-7b9a-4837-8806-6e43b3ebb18d service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:08.643112 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.compute.server_external_events [req-ec3dc3a8-0629-4692-b5fc-b7c579a555e0 req-f9ad7d75-7b9a-4837-8806-6e43b3ebb18d service nova] Creating event network-vif-plugged:ce9c023e-3f65-4600-938f-4bbbb114a9b9 for instance 5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17 on hv-cinder-80374 Aug 07 05:03:08.648056 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [req-ec3dc3a8-0629-4692-b5fc-b7c579a555e0 req-f9ad7d75-7b9a-4837-8806-6e43b3ebb18d service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033839 Aug 07 05:03:08.648993 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 571/1099] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 05:03:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 05:03:09.098761 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-df854807-fca9-46d1-bc25-97e5601fca28 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:03:09.099307 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-df854807-fca9-46d1-bc25-97e5601fca28 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:09.105143 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-df854807-fca9-46d1-bc25-97e5601fca28 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:09.105591 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-df854807-fca9-46d1-bc25-97e5601fca28 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:09.107294 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-df854807-fca9-46d1-bc25-97e5601fca28 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:09.107895 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-df854807-fca9-46d1-bc25-97e5601fca28 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:09.207437 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-ae669917-177a-476b-a554-c53daa2d4593 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:03:09.208139 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-ae669917-177a-476b-a554-c53daa2d4593 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:09.214224 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ae669917-177a-476b-a554-c53daa2d4593 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:09.214667 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ae669917-177a-476b-a554-c53daa2d4593 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:09.215440 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ae669917-177a-476b-a554-c53daa2d4593 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:09.216382 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ae669917-177a-476b-a554-c53daa2d4593 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:09.228489 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-df854807-fca9-46d1-bc25-97e5601fca28 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:09.236930 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-df854807-fca9-46d1-bc25-97e5601fca28 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:09.238579 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-df854807-fca9-46d1-bc25-97e5601fca28 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:09.239704 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-df854807-fca9-46d1-bc25-97e5601fca28 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1721 microversion: 2.20 time: 0.144854 Aug 07 05:03:09.240256 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 529/1100] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:03:09 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1721 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 05:03:09.342553 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-ae669917-177a-476b-a554-c53daa2d4593 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:09.349890 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-ae669917-177a-476b-a554-c53daa2d4593 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17" status: 200 len: 1265 microversion: 2.1 time: 0.146709 Aug 07 05:03:09.350393 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 572/1101] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:03:09 2021] GET /compute/v2.1/servers/5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 05:03:10.257854 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-9d75235d-59ef-4125-9605-d8236ebfdc43 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:03:10.258440 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-9d75235d-59ef-4125-9605-d8236ebfdc43 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:10.264491 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9d75235d-59ef-4125-9605-d8236ebfdc43 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:10.264986 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9d75235d-59ef-4125-9605-d8236ebfdc43 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:10.265746 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9d75235d-59ef-4125-9605-d8236ebfdc43 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:10.266174 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9d75235d-59ef-4125-9605-d8236ebfdc43 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:10.366601 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-a99f4db2-225e-4cdc-b588-d974c6791617 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:03:10.367315 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-a99f4db2-225e-4cdc-b588-d974c6791617 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:10.374427 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a99f4db2-225e-4cdc-b588-d974c6791617 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:10.374949 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a99f4db2-225e-4cdc-b588-d974c6791617 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:10.375794 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a99f4db2-225e-4cdc-b588-d974c6791617 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:10.376300 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a99f4db2-225e-4cdc-b588-d974c6791617 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:10.385739 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-9d75235d-59ef-4125-9605-d8236ebfdc43 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:10.393538 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-9d75235d-59ef-4125-9605-d8236ebfdc43 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:10.395002 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-9d75235d-59ef-4125-9605-d8236ebfdc43 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:10.396112 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-9d75235d-59ef-4125-9605-d8236ebfdc43 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1721 microversion: 2.20 time: 0.142017 Aug 07 05:03:10.396665 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 530/1102] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:03:10 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1721 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 05:03:10.503204 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-a99f4db2-225e-4cdc-b588-d974c6791617 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:10.510598 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-a99f4db2-225e-4cdc-b588-d974c6791617 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17" status: 200 len: 1265 microversion: 2.1 time: 0.147487 Aug 07 05:03:10.511084 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 573/1103] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:03:10 2021] GET /compute/v2.1/servers/5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 05:03:11.413728 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-1460a17d-e290-4b01-98ca-e461b19378a3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:03:11.414336 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-1460a17d-e290-4b01-98ca-e461b19378a3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:11.420561 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1460a17d-e290-4b01-98ca-e461b19378a3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:11.421053 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1460a17d-e290-4b01-98ca-e461b19378a3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:11.421827 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1460a17d-e290-4b01-98ca-e461b19378a3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:11.422265 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1460a17d-e290-4b01-98ca-e461b19378a3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:11.527224 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-d6325a18-ec45-438c-a728-09a7cde60f56 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:03:11.527840 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-d6325a18-ec45-438c-a728-09a7cde60f56 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:11.533907 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d6325a18-ec45-438c-a728-09a7cde60f56 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:11.534356 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d6325a18-ec45-438c-a728-09a7cde60f56 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:11.535137 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d6325a18-ec45-438c-a728-09a7cde60f56 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:11.535571 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d6325a18-ec45-438c-a728-09a7cde60f56 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:11.550903 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-1460a17d-e290-4b01-98ca-e461b19378a3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:11.558578 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-1460a17d-e290-4b01-98ca-e461b19378a3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:11.560834 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-1460a17d-e290-4b01-98ca-e461b19378a3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:11.562015 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-1460a17d-e290-4b01-98ca-e461b19378a3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1721 microversion: 2.20 time: 0.152073 Aug 07 05:03:11.562776 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 531/1104] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:03:11 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 05:03:11.658564 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-d6325a18-ec45-438c-a728-09a7cde60f56 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:11.666053 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-d6325a18-ec45-438c-a728-09a7cde60f56 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17" status: 200 len: 1452 microversion: 2.1 time: 0.142447 Aug 07 05:03:11.666552 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 574/1105] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:03:11 2021] GET /compute/v2.1/servers/5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17 => generated 1452 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 05:03:11.682098 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-c13a3d94-19d3-4104-a701-16d587ea0571 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:03:11.682697 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-c13a3d94-19d3-4104-a701-16d587ea0571 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:11.689089 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c13a3d94-19d3-4104-a701-16d587ea0571 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:11.689535 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c13a3d94-19d3-4104-a701-16d587ea0571 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:11.690290 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c13a3d94-19d3-4104-a701-16d587ea0571 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:11.690717 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c13a3d94-19d3-4104-a701-16d587ea0571 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:11.806274 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-c13a3d94-19d3-4104-a701-16d587ea0571 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:11.814507 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-c13a3d94-19d3-4104-a701-16d587ea0571 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17" status: 200 len: 1452 microversion: 2.1 time: 0.135997 Aug 07 05:03:11.815072 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 532/1106] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:03:11 2021] GET /compute/v2.1/servers/5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17 => generated 1452 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:03:12.580202 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-5bcdc2fe-d38d-4f88-9e35-f18a429856de tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:03:12.580862 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-5bcdc2fe-d38d-4f88-9e35-f18a429856de tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:12.586860 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5bcdc2fe-d38d-4f88-9e35-f18a429856de tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:12.587300 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5bcdc2fe-d38d-4f88-9e35-f18a429856de tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:12.588070 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5bcdc2fe-d38d-4f88-9e35-f18a429856de tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:12.588500 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5bcdc2fe-d38d-4f88-9e35-f18a429856de tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:12.714130 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-5bcdc2fe-d38d-4f88-9e35-f18a429856de tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:12.722645 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-5bcdc2fe-d38d-4f88-9e35-f18a429856de tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:12.724140 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-5bcdc2fe-d38d-4f88-9e35-f18a429856de tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:12.725294 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-5bcdc2fe-d38d-4f88-9e35-f18a429856de tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1742 microversion: 2.20 time: 0.149039 Aug 07 05:03:12.725851 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 575/1107] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:03:12 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1742 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 05:03:13.550417 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [req-182edc42-7d3e-41b6-a80d-7b4336a2a1da req-5ebec4a0-705b-43ee-b748-9cf7e10d2414 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17", "tag": "ce9c023e-3f65-4600-938f-4bbbb114a9b9"}]} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:03:13.552117 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 05:03:13.552117 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: warnings.warn(msg) Aug 07 05:03:13.560082 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-182edc42-7d3e-41b6-a80d-7b4336a2a1da req-5ebec4a0-705b-43ee-b748-9cf7e10d2414 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:13.560525 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-182edc42-7d3e-41b6-a80d-7b4336a2a1da req-5ebec4a0-705b-43ee-b748-9cf7e10d2414 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:13.571229 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.compute.server_external_events [req-182edc42-7d3e-41b6-a80d-7b4336a2a1da req-5ebec4a0-705b-43ee-b748-9cf7e10d2414 service nova] Creating event network-changed:ce9c023e-3f65-4600-938f-4bbbb114a9b9 for instance 5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17 on hv-cinder-80374 Aug 07 05:03:13.577445 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [req-182edc42-7d3e-41b6-a80d-7b4336a2a1da req-5ebec4a0-705b-43ee-b748-9cf7e10d2414 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031236 Aug 07 05:03:13.578271 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 533/1108] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 05:03:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 05:03:13.743382 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-9f535bcb-c5de-4c75-8374-6252f3e67b8d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:03:13.743991 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-9f535bcb-c5de-4c75-8374-6252f3e67b8d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:13.751041 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9f535bcb-c5de-4c75-8374-6252f3e67b8d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:13.751413 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9f535bcb-c5de-4c75-8374-6252f3e67b8d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:13.752374 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9f535bcb-c5de-4c75-8374-6252f3e67b8d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:13.752829 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9f535bcb-c5de-4c75-8374-6252f3e67b8d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:13.883155 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-9f535bcb-c5de-4c75-8374-6252f3e67b8d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:13.892058 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-9f535bcb-c5de-4c75-8374-6252f3e67b8d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:13.894045 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-9f535bcb-c5de-4c75-8374-6252f3e67b8d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:13.895170 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-9f535bcb-c5de-4c75-8374-6252f3e67b8d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1742 microversion: 2.20 time: 0.155566 Aug 07 05:03:13.895964 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 576/1109] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:03:13 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1742 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 05:03:14.914304 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-bdf91dd5-83e3-470a-8421-ec5d2c34e47c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:03:14.915024 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-bdf91dd5-83e3-470a-8421-ec5d2c34e47c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:14.921983 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-bdf91dd5-83e3-470a-8421-ec5d2c34e47c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:14.922428 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-bdf91dd5-83e3-470a-8421-ec5d2c34e47c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:14.923198 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-bdf91dd5-83e3-470a-8421-ec5d2c34e47c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:14.923636 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-bdf91dd5-83e3-470a-8421-ec5d2c34e47c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:15.042988 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-bdf91dd5-83e3-470a-8421-ec5d2c34e47c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:15.051381 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-bdf91dd5-83e3-470a-8421-ec5d2c34e47c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:15.052934 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-bdf91dd5-83e3-470a-8421-ec5d2c34e47c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:15.054070 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-bdf91dd5-83e3-470a-8421-ec5d2c34e47c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1742 microversion: 2.20 time: 0.144095 Aug 07 05:03:15.054628 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 534/1110] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:03:14 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1742 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 05:03:16.071840 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-cd5b4b07-dc1e-4738-af66-001a814867e9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:03:16.072446 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-cd5b4b07-dc1e-4738-af66-001a814867e9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:16.079107 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-cd5b4b07-dc1e-4738-af66-001a814867e9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:16.079590 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-cd5b4b07-dc1e-4738-af66-001a814867e9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:16.080347 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-cd5b4b07-dc1e-4738-af66-001a814867e9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:16.080777 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-cd5b4b07-dc1e-4738-af66-001a814867e9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:16.199547 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-cd5b4b07-dc1e-4738-af66-001a814867e9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:16.207907 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-cd5b4b07-dc1e-4738-af66-001a814867e9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:16.209410 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-cd5b4b07-dc1e-4738-af66-001a814867e9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:16.210538 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-cd5b4b07-dc1e-4738-af66-001a814867e9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1742 microversion: 2.20 time: 0.142433 Aug 07 05:03:16.211083 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 577/1111] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:03:16 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1742 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 05:03:16.655557 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [req-f941a904-c497-41fb-a5bb-8972b173c5b4 req-3201d87c-ccdb-4abe-bbd7-bbbe5fe008bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c28c4450-6a8b-4d0b-b175-29ed3a3b148c", "name": "network-vif-plugged", "status": "completed", "tag": "92b05688-e614-4cbb-9a2c-05ff3d513b8a"}]} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:03:16.657082 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 05:03:16.657082 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: warnings.warn(msg) Aug 07 05:03:16.665049 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-f941a904-c497-41fb-a5bb-8972b173c5b4 req-3201d87c-ccdb-4abe-bbd7-bbbe5fe008bc service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:16.665487 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-f941a904-c497-41fb-a5bb-8972b173c5b4 req-3201d87c-ccdb-4abe-bbd7-bbbe5fe008bc service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:16.676805 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.compute.server_external_events [req-f941a904-c497-41fb-a5bb-8972b173c5b4 req-3201d87c-ccdb-4abe-bbd7-bbbe5fe008bc service nova] Creating event network-vif-plugged:92b05688-e614-4cbb-9a2c-05ff3d513b8a for instance c28c4450-6a8b-4d0b-b175-29ed3a3b148c on hv-cinder-80374 Aug 07 05:03:16.681442 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [req-f941a904-c497-41fb-a5bb-8972b173c5b4 req-3201d87c-ccdb-4abe-bbd7-bbbe5fe008bc service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029724 Aug 07 05:03:16.682024 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 535/1112] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 05:03:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 05:03:17.229231 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-90207331-7777-48e9-a7b0-78f36527949a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:03:17.229777 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-90207331-7777-48e9-a7b0-78f36527949a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:17.236363 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-90207331-7777-48e9-a7b0-78f36527949a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:17.236830 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-90207331-7777-48e9-a7b0-78f36527949a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:17.237603 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-90207331-7777-48e9-a7b0-78f36527949a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:17.238037 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-90207331-7777-48e9-a7b0-78f36527949a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:17.362365 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-90207331-7777-48e9-a7b0-78f36527949a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:17.370520 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-90207331-7777-48e9-a7b0-78f36527949a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:17.372058 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-90207331-7777-48e9-a7b0-78f36527949a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:17.373226 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-90207331-7777-48e9-a7b0-78f36527949a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1742 microversion: 2.20 time: 0.147865 Aug 07 05:03:17.373996 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 578/1113] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:03:17 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1742 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 05:03:18.391748 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-c8328a88-7019-4f66-8a6b-08145b7579cd tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:03:18.392519 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-c8328a88-7019-4f66-8a6b-08145b7579cd tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:18.398653 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c8328a88-7019-4f66-8a6b-08145b7579cd tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:18.399089 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c8328a88-7019-4f66-8a6b-08145b7579cd tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:18.399845 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c8328a88-7019-4f66-8a6b-08145b7579cd tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:18.400272 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c8328a88-7019-4f66-8a6b-08145b7579cd tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:18.525909 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-c8328a88-7019-4f66-8a6b-08145b7579cd tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:18.534079 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-c8328a88-7019-4f66-8a6b-08145b7579cd tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:18.535764 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-c8328a88-7019-4f66-8a6b-08145b7579cd tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:18.537006 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-c8328a88-7019-4f66-8a6b-08145b7579cd tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1742 microversion: 2.20 time: 0.149455 Aug 07 05:03:18.537539 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 536/1114] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:03:18 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1742 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 05:03:19.555996 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-3f7ec0e5-ca6a-423c-9b18-1c26d9fcffb6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:03:19.556701 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-3f7ec0e5-ca6a-423c-9b18-1c26d9fcffb6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:19.563097 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3f7ec0e5-ca6a-423c-9b18-1c26d9fcffb6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:19.563549 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3f7ec0e5-ca6a-423c-9b18-1c26d9fcffb6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:19.564328 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3f7ec0e5-ca6a-423c-9b18-1c26d9fcffb6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:19.564764 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3f7ec0e5-ca6a-423c-9b18-1c26d9fcffb6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:19.696662 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-3f7ec0e5-ca6a-423c-9b18-1c26d9fcffb6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:19.705189 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-3f7ec0e5-ca6a-423c-9b18-1c26d9fcffb6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:19.706672 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-3f7ec0e5-ca6a-423c-9b18-1c26d9fcffb6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:19.708350 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-3f7ec0e5-ca6a-423c-9b18-1c26d9fcffb6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1737 microversion: 2.20 time: 0.156848 Aug 07 05:03:19.716487 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 579/1115] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:03:19 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 05:03:20.727421 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-1f0ded4f-f718-45bb-a8f4-716cbc022343 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:03:20.728090 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-1f0ded4f-f718-45bb-a8f4-716cbc022343 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:20.734613 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1f0ded4f-f718-45bb-a8f4-716cbc022343 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:20.735063 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1f0ded4f-f718-45bb-a8f4-716cbc022343 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:20.735839 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1f0ded4f-f718-45bb-a8f4-716cbc022343 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:20.736272 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1f0ded4f-f718-45bb-a8f4-716cbc022343 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:20.869318 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-1f0ded4f-f718-45bb-a8f4-716cbc022343 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:20.878505 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-1f0ded4f-f718-45bb-a8f4-716cbc022343 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:20.879979 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-1f0ded4f-f718-45bb-a8f4-716cbc022343 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:20.881136 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-1f0ded4f-f718-45bb-a8f4-716cbc022343 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1737 microversion: 2.20 time: 0.157421 Aug 07 05:03:20.881684 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 537/1116] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:03:20 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 05:03:21.899754 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-5c91105f-a11c-42f9-abda-c80a12260a08 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:03:21.900292 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-5c91105f-a11c-42f9-abda-c80a12260a08 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:21.906544 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5c91105f-a11c-42f9-abda-c80a12260a08 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:21.906979 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5c91105f-a11c-42f9-abda-c80a12260a08 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:21.907734 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5c91105f-a11c-42f9-abda-c80a12260a08 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:21.908157 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5c91105f-a11c-42f9-abda-c80a12260a08 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:22.041601 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-5c91105f-a11c-42f9-abda-c80a12260a08 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:22.052434 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-5c91105f-a11c-42f9-abda-c80a12260a08 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:22.053947 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-5c91105f-a11c-42f9-abda-c80a12260a08 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:22.055080 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-5c91105f-a11c-42f9-abda-c80a12260a08 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1737 microversion: 2.20 time: 0.159723 Aug 07 05:03:22.055757 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 580/1117] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:03:21 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 05:03:23.077793 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-981b8285-4cef-4170-9683-240ee89f40ef tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:03:23.078391 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-981b8285-4cef-4170-9683-240ee89f40ef tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:23.086199 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-981b8285-4cef-4170-9683-240ee89f40ef tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:23.087683 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-981b8285-4cef-4170-9683-240ee89f40ef tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:23.088528 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-981b8285-4cef-4170-9683-240ee89f40ef tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:23.089004 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-981b8285-4cef-4170-9683-240ee89f40ef tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:23.259149 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-981b8285-4cef-4170-9683-240ee89f40ef tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:23.274264 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-981b8285-4cef-4170-9683-240ee89f40ef tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:23.275922 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-981b8285-4cef-4170-9683-240ee89f40ef tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:23.277098 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-981b8285-4cef-4170-9683-240ee89f40ef tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1737 microversion: 2.20 time: 0.204885 Aug 07 05:03:23.277648 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 538/1118] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:03:23 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1737 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 05:03:24.297116 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-ec95ecdd-ba8e-4ad6-97c0-c39ab183819c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:03:24.297881 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-ec95ecdd-ba8e-4ad6-97c0-c39ab183819c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:24.304403 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ec95ecdd-ba8e-4ad6-97c0-c39ab183819c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:24.304877 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ec95ecdd-ba8e-4ad6-97c0-c39ab183819c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:24.305657 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ec95ecdd-ba8e-4ad6-97c0-c39ab183819c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:24.306089 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ec95ecdd-ba8e-4ad6-97c0-c39ab183819c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:24.443940 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-ec95ecdd-ba8e-4ad6-97c0-c39ab183819c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:24.453500 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-ec95ecdd-ba8e-4ad6-97c0-c39ab183819c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:24.454772 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-ec95ecdd-ba8e-4ad6-97c0-c39ab183819c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:24.455917 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-ec95ecdd-ba8e-4ad6-97c0-c39ab183819c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1737 microversion: 2.20 time: 0.163833 Aug 07 05:03:24.456467 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 581/1119] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:03:24 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 05:03:25.473545 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-70ca1fff-070a-4799-9aaf-2b4babab6a96 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:03:25.474954 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-70ca1fff-070a-4799-9aaf-2b4babab6a96 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:25.481474 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-70ca1fff-070a-4799-9aaf-2b4babab6a96 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:25.482285 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-70ca1fff-070a-4799-9aaf-2b4babab6a96 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:25.483060 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-70ca1fff-070a-4799-9aaf-2b4babab6a96 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:25.483658 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-70ca1fff-070a-4799-9aaf-2b4babab6a96 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:25.631493 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-70ca1fff-070a-4799-9aaf-2b4babab6a96 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:25.642114 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-70ca1fff-070a-4799-9aaf-2b4babab6a96 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:25.643980 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-70ca1fff-070a-4799-9aaf-2b4babab6a96 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:25.645170 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-70ca1fff-070a-4799-9aaf-2b4babab6a96 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1737 microversion: 2.20 time: 0.175349 Aug 07 05:03:25.645727 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 539/1120] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:03:25 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1737 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 05:03:26.665908 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-eb9fde8c-a715-4104-8691-4196137eb588 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:03:26.666532 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-eb9fde8c-a715-4104-8691-4196137eb588 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:26.673965 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-eb9fde8c-a715-4104-8691-4196137eb588 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:26.674346 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-eb9fde8c-a715-4104-8691-4196137eb588 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:26.675141 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-eb9fde8c-a715-4104-8691-4196137eb588 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:26.675582 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-eb9fde8c-a715-4104-8691-4196137eb588 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:26.808122 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-eb9fde8c-a715-4104-8691-4196137eb588 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:26.817207 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-eb9fde8c-a715-4104-8691-4196137eb588 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:26.818684 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-eb9fde8c-a715-4104-8691-4196137eb588 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:26.819832 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-eb9fde8c-a715-4104-8691-4196137eb588 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1737 microversion: 2.20 time: 0.157817 Aug 07 05:03:26.823386 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 582/1121] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:03:26 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 05:03:27.837825 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-5cbd3b7c-ad8d-4d39-a5e2-cb194de5f412 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:03:27.839160 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-5cbd3b7c-ad8d-4d39-a5e2-cb194de5f412 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:27.846543 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5cbd3b7c-ad8d-4d39-a5e2-cb194de5f412 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:27.846994 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5cbd3b7c-ad8d-4d39-a5e2-cb194de5f412 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:27.848047 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5cbd3b7c-ad8d-4d39-a5e2-cb194de5f412 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:27.848504 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5cbd3b7c-ad8d-4d39-a5e2-cb194de5f412 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:27.979474 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-5cbd3b7c-ad8d-4d39-a5e2-cb194de5f412 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:27.993618 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-5cbd3b7c-ad8d-4d39-a5e2-cb194de5f412 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:27.995098 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-5cbd3b7c-ad8d-4d39-a5e2-cb194de5f412 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:28.000316 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-5cbd3b7c-ad8d-4d39-a5e2-cb194de5f412 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1737 microversion: 2.20 time: 0.165769 Aug 07 05:03:28.011322 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 540/1122] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:03:27 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1737 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 05:03:29.019994 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-a4815562-da75-4f19-a7e3-b323b8815e8c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:03:29.020547 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-a4815562-da75-4f19-a7e3-b323b8815e8c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:29.026686 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a4815562-da75-4f19-a7e3-b323b8815e8c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:29.027141 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a4815562-da75-4f19-a7e3-b323b8815e8c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:29.027930 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a4815562-da75-4f19-a7e3-b323b8815e8c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:29.028965 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a4815562-da75-4f19-a7e3-b323b8815e8c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:29.170391 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-a4815562-da75-4f19-a7e3-b323b8815e8c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:29.178698 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-a4815562-da75-4f19-a7e3-b323b8815e8c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:29.180200 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-a4815562-da75-4f19-a7e3-b323b8815e8c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:29.181430 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-a4815562-da75-4f19-a7e3-b323b8815e8c tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1737 microversion: 2.20 time: 0.165297 Aug 07 05:03:29.182274 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 583/1123] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:03:29 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 05:03:30.201221 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-5acef95e-03be-4978-83f4-b58f19c552ad tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:03:30.201932 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-5acef95e-03be-4978-83f4-b58f19c552ad tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:30.208228 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5acef95e-03be-4978-83f4-b58f19c552ad tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:30.208664 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5acef95e-03be-4978-83f4-b58f19c552ad tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:30.209462 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5acef95e-03be-4978-83f4-b58f19c552ad tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:30.209893 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5acef95e-03be-4978-83f4-b58f19c552ad tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:30.334543 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-5acef95e-03be-4978-83f4-b58f19c552ad tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:30.342421 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-5acef95e-03be-4978-83f4-b58f19c552ad tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:30.343894 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-5acef95e-03be-4978-83f4-b58f19c552ad tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:30.345279 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-5acef95e-03be-4978-83f4-b58f19c552ad tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1737 microversion: 2.20 time: 0.148508 Aug 07 05:03:30.345817 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 541/1124] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:03:30 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 05:03:31.363375 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-c20ac1f3-9293-45a0-949c-1da2a50f76b4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:03:31.364009 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-c20ac1f3-9293-45a0-949c-1da2a50f76b4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:31.369805 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c20ac1f3-9293-45a0-949c-1da2a50f76b4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:31.370253 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c20ac1f3-9293-45a0-949c-1da2a50f76b4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:31.371016 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c20ac1f3-9293-45a0-949c-1da2a50f76b4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:31.371449 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c20ac1f3-9293-45a0-949c-1da2a50f76b4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:31.502133 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-c20ac1f3-9293-45a0-949c-1da2a50f76b4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:31.509827 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-c20ac1f3-9293-45a0-949c-1da2a50f76b4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:31.511465 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-c20ac1f3-9293-45a0-949c-1da2a50f76b4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:31.512866 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-c20ac1f3-9293-45a0-949c-1da2a50f76b4 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1719 microversion: 2.20 time: 0.153128 Aug 07 05:03:31.513414 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 584/1125] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:03:31 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1719 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 05:03:32.530418 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-f152bb91-81e4-4eb1-ba25-a1c5314fdf61 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:03:32.531037 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-f152bb91-81e4-4eb1-ba25-a1c5314fdf61 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:32.536978 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f152bb91-81e4-4eb1-ba25-a1c5314fdf61 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:32.537430 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f152bb91-81e4-4eb1-ba25-a1c5314fdf61 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:32.538201 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f152bb91-81e4-4eb1-ba25-a1c5314fdf61 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:32.538638 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f152bb91-81e4-4eb1-ba25-a1c5314fdf61 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:32.657958 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-f152bb91-81e4-4eb1-ba25-a1c5314fdf61 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:32.665693 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-f152bb91-81e4-4eb1-ba25-a1c5314fdf61 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:32.667176 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-f152bb91-81e4-4eb1-ba25-a1c5314fdf61 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:32.668304 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-f152bb91-81e4-4eb1-ba25-a1c5314fdf61 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1719 microversion: 2.20 time: 0.141678 Aug 07 05:03:32.669442 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 542/1126] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:03:32 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1719 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 05:03:33.687228 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-b03dff2b-a2d1-49ac-a9a2-d2c51e57199d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:03:33.687825 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-b03dff2b-a2d1-49ac-a9a2-d2c51e57199d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:33.693598 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b03dff2b-a2d1-49ac-a9a2-d2c51e57199d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:33.694037 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b03dff2b-a2d1-49ac-a9a2-d2c51e57199d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:33.694792 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b03dff2b-a2d1-49ac-a9a2-d2c51e57199d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:33.695216 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b03dff2b-a2d1-49ac-a9a2-d2c51e57199d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:33.826983 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-b03dff2b-a2d1-49ac-a9a2-d2c51e57199d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:33.835746 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-b03dff2b-a2d1-49ac-a9a2-d2c51e57199d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:33.837492 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-b03dff2b-a2d1-49ac-a9a2-d2c51e57199d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:33.838620 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-b03dff2b-a2d1-49ac-a9a2-d2c51e57199d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1719 microversion: 2.20 time: 0.155791 Aug 07 05:03:33.839169 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 585/1127] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:03:33 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1719 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 05:03:34.673172 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [req-518031ac-e53e-4895-ba48-a6c4ba124707 req-13de3611-8ef7-4868-a5ec-4163a40b3e2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c28c4450-6a8b-4d0b-b175-29ed3a3b148c", "name": "network-vif-unplugged", "status": "completed", "tag": "92b05688-e614-4cbb-9a2c-05ff3d513b8a"}]} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:03:34.674676 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 05:03:34.674676 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: warnings.warn(msg) Aug 07 05:03:34.681442 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-518031ac-e53e-4895-ba48-a6c4ba124707 req-13de3611-8ef7-4868-a5ec-4163a40b3e2e service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:34.681887 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-518031ac-e53e-4895-ba48-a6c4ba124707 req-13de3611-8ef7-4868-a5ec-4163a40b3e2e service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:34.693848 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.compute.server_external_events [req-518031ac-e53e-4895-ba48-a6c4ba124707 req-13de3611-8ef7-4868-a5ec-4163a40b3e2e service nova] Unable to find a host for instance c28c4450-6a8b-4d0b-b175-29ed3a3b148c. Dropping event network-vif-unplugged {{(pid=107485) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Aug 07 05:03:34.694725 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [req-518031ac-e53e-4895-ba48-a6c4ba124707 req-13de3611-8ef7-4868-a5ec-4163a40b3e2e service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025984 Aug 07 05:03:34.695310 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 543/1128] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 05:03:34 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 07 05:03:34.857332 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-7bd68d68-7942-4f3a-ac2d-a85c79c552dc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:03:34.857936 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-7bd68d68-7942-4f3a-ac2d-a85c79c552dc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:34.863986 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-7bd68d68-7942-4f3a-ac2d-a85c79c552dc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:34.864428 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-7bd68d68-7942-4f3a-ac2d-a85c79c552dc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:34.865237 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-7bd68d68-7942-4f3a-ac2d-a85c79c552dc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:34.865663 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-7bd68d68-7942-4f3a-ac2d-a85c79c552dc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:34.984455 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-7bd68d68-7942-4f3a-ac2d-a85c79c552dc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:34.992072 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-7bd68d68-7942-4f3a-ac2d-a85c79c552dc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:34.993590 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-7bd68d68-7942-4f3a-ac2d-a85c79c552dc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:34.994711 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-7bd68d68-7942-4f3a-ac2d-a85c79c552dc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1662 microversion: 2.20 time: 0.141804 Aug 07 05:03:34.995254 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 586/1129] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:03:34 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1662 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 05:03:35.012311 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-0a22ef59-2f8f-4428-8113-848c9fb8c911 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "14720c79-c49a-4a40-ba89-567e4077397e"}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:03:35.013442 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-0a22ef59-2f8f-4428-8113-848c9fb8c911 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:35.019291 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0a22ef59-2f8f-4428-8113-848c9fb8c911 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:35.019735 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0a22ef59-2f8f-4428-8113-848c9fb8c911 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:35.020505 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0a22ef59-2f8f-4428-8113-848c9fb8c911 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:35.020966 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0a22ef59-2f8f-4428-8113-848c9fb8c911 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:35.277718 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-0a22ef59-2f8f-4428-8113-848c9fb8c911 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.269314 Aug 07 05:03:35.278456 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 544/1130] 10.222.0.35 () {62 vars in 1364 bytes} [Sat Aug 7 05:03:35 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/os-volume_attachments => generated 188 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:03:35.396091 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-115ece15-fb78-4738-8af2-55e14827c3d6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:03:35.396572 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-115ece15-fb78-4738-8af2-55e14827c3d6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:35.402272 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-115ece15-fb78-4738-8af2-55e14827c3d6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:35.402714 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-115ece15-fb78-4738-8af2-55e14827c3d6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:35.403818 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-115ece15-fb78-4738-8af2-55e14827c3d6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:35.404246 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-115ece15-fb78-4738-8af2-55e14827c3d6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:35.650772 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-115ece15-fb78-4738-8af2-55e14827c3d6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "DELETE /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/os-volume_attachments/14720c79-c49a-4a40-ba89-567e4077397e" status: 202 len: 0 microversion: 2.20 time: 0.258382 Aug 07 05:03:35.651361 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 587/1131] 10.222.0.35 () {60 vars in 1457 bytes} [Sat Aug 7 05:03:35 2021] DELETE /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/os-volume_attachments/14720c79-c49a-4a40-ba89-567e4077397e => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 07 05:03:35.708597 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-4a2e9d48-b1ec-44ea-a754-bb56bc4aeb60 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:03:35.709202 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-4a2e9d48-b1ec-44ea-a754-bb56bc4aeb60 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:35.716233 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4a2e9d48-b1ec-44ea-a754-bb56bc4aeb60 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:35.716675 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4a2e9d48-b1ec-44ea-a754-bb56bc4aeb60 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:35.717494 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4a2e9d48-b1ec-44ea-a754-bb56bc4aeb60 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:35.717924 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4a2e9d48-b1ec-44ea-a754-bb56bc4aeb60 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:35.791896 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-4a2e9d48-b1ec-44ea-a754-bb56bc4aeb60 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action" status: 202 len: 0 microversion: 2.20 time: 0.087201 Aug 07 05:03:35.792493 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 545/1132] 10.222.0.35 () {62 vars in 1319 bytes} [Sat Aug 7 05:03:35 2021] POST /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 07 05:03:35.800561 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-501af3d4-53ca-40f4-8572-d9eca3e5afa7 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:03:35.801448 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-501af3d4-53ca-40f4-8572-d9eca3e5afa7 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:35.807356 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-501af3d4-53ca-40f4-8572-d9eca3e5afa7 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:35.807875 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-501af3d4-53ca-40f4-8572-d9eca3e5afa7 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:35.808699 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-501af3d4-53ca-40f4-8572-d9eca3e5afa7 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:35.809673 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-501af3d4-53ca-40f4-8572-d9eca3e5afa7 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:35.931179 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-501af3d4-53ca-40f4-8572-d9eca3e5afa7 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:35.939584 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-501af3d4-53ca-40f4-8572-d9eca3e5afa7 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:35.941078 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-501af3d4-53ca-40f4-8572-d9eca3e5afa7 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:35.942206 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-501af3d4-53ca-40f4-8572-d9eca3e5afa7 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1670 microversion: 2.20 time: 0.145417 Aug 07 05:03:35.942752 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 588/1133] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:03:35 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1670 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 05:03:36.961343 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-821a71bc-85fe-42ce-98f6-fe58e80d5b09 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:03:36.961944 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-821a71bc-85fe-42ce-98f6-fe58e80d5b09 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:36.967932 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-821a71bc-85fe-42ce-98f6-fe58e80d5b09 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:36.968371 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-821a71bc-85fe-42ce-98f6-fe58e80d5b09 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:36.969177 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-821a71bc-85fe-42ce-98f6-fe58e80d5b09 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:36.969670 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-821a71bc-85fe-42ce-98f6-fe58e80d5b09 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:37.401037 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-821a71bc-85fe-42ce-98f6-fe58e80d5b09 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:37.409518 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-821a71bc-85fe-42ce-98f6-fe58e80d5b09 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:37.411010 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-821a71bc-85fe-42ce-98f6-fe58e80d5b09 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:37.412148 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-821a71bc-85fe-42ce-98f6-fe58e80d5b09 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1728 microversion: 2.20 time: 0.454695 Aug 07 05:03:37.412715 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 546/1134] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:03:36 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1728 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 05:03:38.430517 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-b0c8f757-924d-43cb-bb9b-b40838764eed tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:03:38.431198 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-b0c8f757-924d-43cb-bb9b-b40838764eed tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:38.437996 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b0c8f757-924d-43cb-bb9b-b40838764eed tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:38.438547 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b0c8f757-924d-43cb-bb9b-b40838764eed tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:38.439419 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b0c8f757-924d-43cb-bb9b-b40838764eed tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:38.439885 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b0c8f757-924d-43cb-bb9b-b40838764eed tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:38.567407 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-b0c8f757-924d-43cb-bb9b-b40838764eed tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:38.576518 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-b0c8f757-924d-43cb-bb9b-b40838764eed tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:38.578043 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-b0c8f757-924d-43cb-bb9b-b40838764eed tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:38.579655 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-b0c8f757-924d-43cb-bb9b-b40838764eed tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1728 microversion: 2.20 time: 0.152972 Aug 07 05:03:38.580749 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 589/1135] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:03:38 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 05:03:39.599195 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-1e61de1d-fb13-4fef-85d6-d423877b1d04 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:03:39.599783 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-1e61de1d-fb13-4fef-85d6-d423877b1d04 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:39.605499 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1e61de1d-fb13-4fef-85d6-d423877b1d04 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:39.606563 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1e61de1d-fb13-4fef-85d6-d423877b1d04 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:39.607317 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1e61de1d-fb13-4fef-85d6-d423877b1d04 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:39.607769 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1e61de1d-fb13-4fef-85d6-d423877b1d04 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:39.738523 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-1e61de1d-fb13-4fef-85d6-d423877b1d04 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:39.751769 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-1e61de1d-fb13-4fef-85d6-d423877b1d04 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:39.753408 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-1e61de1d-fb13-4fef-85d6-d423877b1d04 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:39.754588 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-1e61de1d-fb13-4fef-85d6-d423877b1d04 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1728 microversion: 2.20 time: 0.159122 Aug 07 05:03:39.755138 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 547/1136] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:03:39 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 05:03:40.773208 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-f31038c4-3a5c-4b8a-9bcb-d339bd95a3ef tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:03:40.773819 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-f31038c4-3a5c-4b8a-9bcb-d339bd95a3ef tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:40.780669 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f31038c4-3a5c-4b8a-9bcb-d339bd95a3ef tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:40.781140 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f31038c4-3a5c-4b8a-9bcb-d339bd95a3ef tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:40.781918 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f31038c4-3a5c-4b8a-9bcb-d339bd95a3ef tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:40.782350 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f31038c4-3a5c-4b8a-9bcb-d339bd95a3ef tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:40.965735 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-f31038c4-3a5c-4b8a-9bcb-d339bd95a3ef tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:40.975691 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-f31038c4-3a5c-4b8a-9bcb-d339bd95a3ef tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:40.977205 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-f31038c4-3a5c-4b8a-9bcb-d339bd95a3ef tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:40.978333 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-f31038c4-3a5c-4b8a-9bcb-d339bd95a3ef tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1728 microversion: 2.20 time: 0.209068 Aug 07 05:03:40.978890 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 590/1137] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:03:40 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1728 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 05:03:41.998283 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-30f68d19-02a3-47a5-b39d-10cda913c080 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:03:41.998850 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-30f68d19-02a3-47a5-b39d-10cda913c080 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:42.004683 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-30f68d19-02a3-47a5-b39d-10cda913c080 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:42.005155 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-30f68d19-02a3-47a5-b39d-10cda913c080 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:42.005915 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-30f68d19-02a3-47a5-b39d-10cda913c080 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:42.006346 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-30f68d19-02a3-47a5-b39d-10cda913c080 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:42.198011 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-30f68d19-02a3-47a5-b39d-10cda913c080 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:42.208348 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-30f68d19-02a3-47a5-b39d-10cda913c080 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:42.210856 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-30f68d19-02a3-47a5-b39d-10cda913c080 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:42.212299 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-30f68d19-02a3-47a5-b39d-10cda913c080 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1728 microversion: 2.20 time: 0.217865 Aug 07 05:03:42.213815 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 548/1138] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:03:41 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1728 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 05:03:43.230977 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-145da796-55fc-478c-9791-ec5537690c72 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:03:43.231527 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-145da796-55fc-478c-9791-ec5537690c72 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:43.238200 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-145da796-55fc-478c-9791-ec5537690c72 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:43.238641 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-145da796-55fc-478c-9791-ec5537690c72 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:43.239409 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-145da796-55fc-478c-9791-ec5537690c72 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:43.239838 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-145da796-55fc-478c-9791-ec5537690c72 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:43.390297 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-145da796-55fc-478c-9791-ec5537690c72 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:43.398976 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-145da796-55fc-478c-9791-ec5537690c72 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:43.400463 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-145da796-55fc-478c-9791-ec5537690c72 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:43.401642 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-145da796-55fc-478c-9791-ec5537690c72 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1728 microversion: 2.20 time: 0.174524 Aug 07 05:03:43.412568 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 591/1139] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:03:43 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1728 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 05:03:44.419491 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-4c9b2231-e65b-4dc9-965b-053693e61ee3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:03:44.421031 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-4c9b2231-e65b-4dc9-965b-053693e61ee3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:44.438327 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4c9b2231-e65b-4dc9-965b-053693e61ee3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:44.438804 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4c9b2231-e65b-4dc9-965b-053693e61ee3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:44.439616 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4c9b2231-e65b-4dc9-965b-053693e61ee3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:44.440047 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4c9b2231-e65b-4dc9-965b-053693e61ee3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:44.568566 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-4c9b2231-e65b-4dc9-965b-053693e61ee3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:44.577186 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-4c9b2231-e65b-4dc9-965b-053693e61ee3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:44.578690 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-4c9b2231-e65b-4dc9-965b-053693e61ee3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:44.579868 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-4c9b2231-e65b-4dc9-965b-053693e61ee3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1728 microversion: 2.20 time: 0.164094 Aug 07 05:03:44.584317 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 549/1140] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:03:44 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 05:03:45.598276 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-4131d404-fae9-4a58-ab43-f9f3871d2348 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:03:45.599025 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-4131d404-fae9-4a58-ab43-f9f3871d2348 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:45.604944 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4131d404-fae9-4a58-ab43-f9f3871d2348 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:45.605386 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4131d404-fae9-4a58-ab43-f9f3871d2348 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:45.606158 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4131d404-fae9-4a58-ab43-f9f3871d2348 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:45.606583 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4131d404-fae9-4a58-ab43-f9f3871d2348 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:45.734037 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-4131d404-fae9-4a58-ab43-f9f3871d2348 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:45.741630 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-4131d404-fae9-4a58-ab43-f9f3871d2348 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:45.743099 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-4131d404-fae9-4a58-ab43-f9f3871d2348 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:45.744239 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-4131d404-fae9-4a58-ab43-f9f3871d2348 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1728 microversion: 2.20 time: 0.149821 Aug 07 05:03:45.744805 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 592/1141] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:03:45 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 05:03:46.762416 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-fc3fea69-b598-4595-9502-cd174b468889 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:03:46.763080 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-fc3fea69-b598-4595-9502-cd174b468889 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:46.769739 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-fc3fea69-b598-4595-9502-cd174b468889 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:46.770259 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-fc3fea69-b598-4595-9502-cd174b468889 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:46.771129 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-fc3fea69-b598-4595-9502-cd174b468889 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:46.771656 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-fc3fea69-b598-4595-9502-cd174b468889 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:46.897108 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-fc3fea69-b598-4595-9502-cd174b468889 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:46.905906 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-fc3fea69-b598-4595-9502-cd174b468889 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:46.907371 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-fc3fea69-b598-4595-9502-cd174b468889 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:46.908504 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-fc3fea69-b598-4595-9502-cd174b468889 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1728 microversion: 2.20 time: 0.149858 Aug 07 05:03:46.909146 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 550/1142] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:03:46 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 05:03:47.926603 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-6f2ce26b-bffd-4a22-b6be-3aa79313be3e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:03:47.927217 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-6f2ce26b-bffd-4a22-b6be-3aa79313be3e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:47.933119 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6f2ce26b-bffd-4a22-b6be-3aa79313be3e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:47.933559 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6f2ce26b-bffd-4a22-b6be-3aa79313be3e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:47.934311 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6f2ce26b-bffd-4a22-b6be-3aa79313be3e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:47.934738 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6f2ce26b-bffd-4a22-b6be-3aa79313be3e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:48.057890 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-6f2ce26b-bffd-4a22-b6be-3aa79313be3e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:48.066247 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-6f2ce26b-bffd-4a22-b6be-3aa79313be3e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:48.067737 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-6f2ce26b-bffd-4a22-b6be-3aa79313be3e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:48.068930 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-6f2ce26b-bffd-4a22-b6be-3aa79313be3e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1728 microversion: 2.20 time: 0.146060 Aug 07 05:03:48.069494 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 593/1143] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:03:47 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1728 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 05:03:49.087951 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-84937cb6-692a-4b6a-a744-df7633e81ef7 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:03:49.088732 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-84937cb6-692a-4b6a-a744-df7633e81ef7 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:49.095810 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-84937cb6-692a-4b6a-a744-df7633e81ef7 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:49.096290 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-84937cb6-692a-4b6a-a744-df7633e81ef7 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:49.097148 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-84937cb6-692a-4b6a-a744-df7633e81ef7 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:49.097606 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-84937cb6-692a-4b6a-a744-df7633e81ef7 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:49.203833 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 05:03:49.204398 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: Sat Aug 7 05:03:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c (ip 10.222.0.35) !!! Aug 07 05:03:49.237534 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-84937cb6-692a-4b6a-a744-df7633e81ef7 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:49.245843 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-84937cb6-692a-4b6a-a744-df7633e81ef7 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:49.247318 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-84937cb6-692a-4b6a-a744-df7633e81ef7 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:49.248510 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-84937cb6-692a-4b6a-a744-df7633e81ef7 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1728 microversion: 2.20 time: 0.164240 Aug 07 05:03:49.249097 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 551/1144] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:03:49 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 05:03:50.362408 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-02bd0a35-43f9-40db-bb76-8d93a385931e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:03:50.363953 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-02bd0a35-43f9-40db-bb76-8d93a385931e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:50.370484 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-02bd0a35-43f9-40db-bb76-8d93a385931e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:50.371198 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-02bd0a35-43f9-40db-bb76-8d93a385931e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:50.372254 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-02bd0a35-43f9-40db-bb76-8d93a385931e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:50.372888 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-02bd0a35-43f9-40db-bb76-8d93a385931e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:50.510082 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-02bd0a35-43f9-40db-bb76-8d93a385931e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:50.518512 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-02bd0a35-43f9-40db-bb76-8d93a385931e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:50.520010 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-02bd0a35-43f9-40db-bb76-8d93a385931e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:50.521201 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-02bd0a35-43f9-40db-bb76-8d93a385931e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1728 microversion: 2.20 time: 0.258132 Aug 07 05:03:50.521753 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 594/1145] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:03:50 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1728 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 05:03:51.539495 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-67410ac9-9c23-46cd-a807-3db93d9412e9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:03:51.540082 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-67410ac9-9c23-46cd-a807-3db93d9412e9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:51.546065 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-67410ac9-9c23-46cd-a807-3db93d9412e9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:51.547013 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-67410ac9-9c23-46cd-a807-3db93d9412e9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:51.547806 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-67410ac9-9c23-46cd-a807-3db93d9412e9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:51.548893 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-67410ac9-9c23-46cd-a807-3db93d9412e9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:51.672888 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-67410ac9-9c23-46cd-a807-3db93d9412e9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:51.680593 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-67410ac9-9c23-46cd-a807-3db93d9412e9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:51.682113 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-67410ac9-9c23-46cd-a807-3db93d9412e9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:51.683246 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-67410ac9-9c23-46cd-a807-3db93d9412e9 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1728 microversion: 2.20 time: 0.147898 Aug 07 05:03:51.683803 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 552/1146] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:03:51 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 05:03:52.701159 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-1846969b-e6f7-44b8-a8ac-719a341a86cc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:03:52.701765 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-1846969b-e6f7-44b8-a8ac-719a341a86cc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:52.708552 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1846969b-e6f7-44b8-a8ac-719a341a86cc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:52.709030 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1846969b-e6f7-44b8-a8ac-719a341a86cc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:52.709782 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1846969b-e6f7-44b8-a8ac-719a341a86cc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:52.710206 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1846969b-e6f7-44b8-a8ac-719a341a86cc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:52.828361 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-1846969b-e6f7-44b8-a8ac-719a341a86cc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:52.836470 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-1846969b-e6f7-44b8-a8ac-719a341a86cc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:52.838020 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-1846969b-e6f7-44b8-a8ac-719a341a86cc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:52.839159 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-1846969b-e6f7-44b8-a8ac-719a341a86cc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1728 microversion: 2.20 time: 0.141798 Aug 07 05:03:52.839718 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 595/1147] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:03:52 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1728 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 05:03:53.857135 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-552140e2-63d3-4420-aa0a-707c7b5c9781 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:03:53.857739 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-552140e2-63d3-4420-aa0a-707c7b5c9781 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:53.863710 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-552140e2-63d3-4420-aa0a-707c7b5c9781 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:53.864137 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-552140e2-63d3-4420-aa0a-707c7b5c9781 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:53.864911 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-552140e2-63d3-4420-aa0a-707c7b5c9781 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:53.865337 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-552140e2-63d3-4420-aa0a-707c7b5c9781 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:53.982289 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-552140e2-63d3-4420-aa0a-707c7b5c9781 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:53.990008 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-552140e2-63d3-4420-aa0a-707c7b5c9781 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:53.991504 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-552140e2-63d3-4420-aa0a-707c7b5c9781 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:53.992644 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-552140e2-63d3-4420-aa0a-707c7b5c9781 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1728 microversion: 2.20 time: 0.139229 Aug 07 05:03:53.993250 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 553/1148] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:03:53 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1728 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 05:03:55.011192 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-dcf937ce-2b6c-492b-8a41-10d9bbe96697 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:03:55.011834 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-dcf937ce-2b6c-492b-8a41-10d9bbe96697 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:55.018523 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-dcf937ce-2b6c-492b-8a41-10d9bbe96697 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:55.018969 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-dcf937ce-2b6c-492b-8a41-10d9bbe96697 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:55.019730 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-dcf937ce-2b6c-492b-8a41-10d9bbe96697 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:55.020163 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-dcf937ce-2b6c-492b-8a41-10d9bbe96697 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:55.142456 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-dcf937ce-2b6c-492b-8a41-10d9bbe96697 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:55.150108 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-dcf937ce-2b6c-492b-8a41-10d9bbe96697 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:55.151582 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-dcf937ce-2b6c-492b-8a41-10d9bbe96697 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:55.152709 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-dcf937ce-2b6c-492b-8a41-10d9bbe96697 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1728 microversion: 2.20 time: 0.145221 Aug 07 05:03:55.153293 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 596/1149] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:03:55 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1728 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 05:03:56.171983 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-e0124ba0-6952-4762-aaeb-b5236ae3b20e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:03:56.172574 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-e0124ba0-6952-4762-aaeb-b5236ae3b20e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:56.178482 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e0124ba0-6952-4762-aaeb-b5236ae3b20e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:56.178935 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e0124ba0-6952-4762-aaeb-b5236ae3b20e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:56.179698 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e0124ba0-6952-4762-aaeb-b5236ae3b20e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:56.180131 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e0124ba0-6952-4762-aaeb-b5236ae3b20e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:56.300098 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-e0124ba0-6952-4762-aaeb-b5236ae3b20e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:56.307726 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-e0124ba0-6952-4762-aaeb-b5236ae3b20e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:56.309226 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-e0124ba0-6952-4762-aaeb-b5236ae3b20e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:56.310337 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-e0124ba0-6952-4762-aaeb-b5236ae3b20e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1728 microversion: 2.20 time: 0.142808 Aug 07 05:03:56.310891 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 554/1150] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:03:56 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1728 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 05:03:57.328948 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-3b55429b-b5b2-4c60-972a-fe11881c00ca tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:03:57.329547 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-3b55429b-b5b2-4c60-972a-fe11881c00ca tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:57.335623 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3b55429b-b5b2-4c60-972a-fe11881c00ca tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:57.336067 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3b55429b-b5b2-4c60-972a-fe11881c00ca tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:57.336868 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3b55429b-b5b2-4c60-972a-fe11881c00ca tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:57.337269 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3b55429b-b5b2-4c60-972a-fe11881c00ca tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:57.468409 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-3b55429b-b5b2-4c60-972a-fe11881c00ca tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:57.476774 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-3b55429b-b5b2-4c60-972a-fe11881c00ca tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:57.478282 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-3b55429b-b5b2-4c60-972a-fe11881c00ca tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:57.479415 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-3b55429b-b5b2-4c60-972a-fe11881c00ca tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1728 microversion: 2.20 time: 0.154830 Aug 07 05:03:57.479972 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 597/1151] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:03:57 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 05:03:58.497482 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-abe8b5d3-c621-4015-b2c2-f8cb4e4e4908 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:03:58.498083 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-abe8b5d3-c621-4015-b2c2-f8cb4e4e4908 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:58.504191 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-abe8b5d3-c621-4015-b2c2-f8cb4e4e4908 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:58.504636 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-abe8b5d3-c621-4015-b2c2-f8cb4e4e4908 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:58.505433 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-abe8b5d3-c621-4015-b2c2-f8cb4e4e4908 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:58.505865 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-abe8b5d3-c621-4015-b2c2-f8cb4e4e4908 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:58.626995 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-abe8b5d3-c621-4015-b2c2-f8cb4e4e4908 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:58.635033 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-abe8b5d3-c621-4015-b2c2-f8cb4e4e4908 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:58.636502 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-abe8b5d3-c621-4015-b2c2-f8cb4e4e4908 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:58.637649 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-abe8b5d3-c621-4015-b2c2-f8cb4e4e4908 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1728 microversion: 2.20 time: 0.143898 Aug 07 05:03:58.638196 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 555/1152] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:03:58 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1728 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 05:03:58.855036 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [req-32a5e151-6b97-45ba-b5d8-8c04df54764f req-13adae57-41b7-4793-8d35-b7bc0fd89f1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c28c4450-6a8b-4d0b-b175-29ed3a3b148c", "name": "network-vif-plugged", "status": "completed", "tag": "92b05688-e614-4cbb-9a2c-05ff3d513b8a"}]} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:03:58.856655 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 05:03:58.856655 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: warnings.warn(msg) Aug 07 05:03:58.864103 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-32a5e151-6b97-45ba-b5d8-8c04df54764f req-13adae57-41b7-4793-8d35-b7bc0fd89f1e service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:58.864544 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-32a5e151-6b97-45ba-b5d8-8c04df54764f req-13adae57-41b7-4793-8d35-b7bc0fd89f1e service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:58.875915 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.compute.server_external_events [req-32a5e151-6b97-45ba-b5d8-8c04df54764f req-13adae57-41b7-4793-8d35-b7bc0fd89f1e service nova] Creating event network-vif-plugged:92b05688-e614-4cbb-9a2c-05ff3d513b8a for instance c28c4450-6a8b-4d0b-b175-29ed3a3b148c on hv-cinder-80374 Aug 07 05:03:58.881023 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [req-32a5e151-6b97-45ba-b5d8-8c04df54764f req-13adae57-41b7-4793-8d35-b7bc0fd89f1e service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029642 Aug 07 05:03:58.881950 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 598/1153] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 05:03:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 05:03:59.659374 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-0419b024-876f-4fdd-9dfb-d8875786385d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:03:59.659973 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-0419b024-876f-4fdd-9dfb-d8875786385d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:03:59.665880 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0419b024-876f-4fdd-9dfb-d8875786385d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:59.666318 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0419b024-876f-4fdd-9dfb-d8875786385d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:59.667067 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0419b024-876f-4fdd-9dfb-d8875786385d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:03:59.667491 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0419b024-876f-4fdd-9dfb-d8875786385d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:03:59.788150 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-0419b024-876f-4fdd-9dfb-d8875786385d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:59.796268 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-0419b024-876f-4fdd-9dfb-d8875786385d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:59.797782 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-0419b024-876f-4fdd-9dfb-d8875786385d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:03:59.798910 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-0419b024-876f-4fdd-9dfb-d8875786385d tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1728 microversion: 2.20 time: 0.143292 Aug 07 05:03:59.799467 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 556/1154] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:03:59 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1728 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 05:04:00.818375 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-1a7ebb2b-1907-45d6-8b39-c4cf14889e01 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:04:00.819260 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-1a7ebb2b-1907-45d6-8b39-c4cf14889e01 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:04:00.825722 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1a7ebb2b-1907-45d6-8b39-c4cf14889e01 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:04:00.826240 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1a7ebb2b-1907-45d6-8b39-c4cf14889e01 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:04:00.828467 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1a7ebb2b-1907-45d6-8b39-c4cf14889e01 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:04:00.829027 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1a7ebb2b-1907-45d6-8b39-c4cf14889e01 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:04:00.955067 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-1a7ebb2b-1907-45d6-8b39-c4cf14889e01 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:04:00.963638 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-1a7ebb2b-1907-45d6-8b39-c4cf14889e01 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:04:00.965032 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-1a7ebb2b-1907-45d6-8b39-c4cf14889e01 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:04:00.966193 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-1a7ebb2b-1907-45d6-8b39-c4cf14889e01 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1728 microversion: 2.20 time: 0.152055 Aug 07 05:04:00.966746 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 599/1155] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:04:00 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 05:04:01.985340 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-d31a3925-0483-4eee-965e-8e1e678080b5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:04:01.986000 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-d31a3925-0483-4eee-965e-8e1e678080b5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:04:01.991713 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d31a3925-0483-4eee-965e-8e1e678080b5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:04:01.992159 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d31a3925-0483-4eee-965e-8e1e678080b5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:04:01.992957 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d31a3925-0483-4eee-965e-8e1e678080b5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:04:01.993391 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d31a3925-0483-4eee-965e-8e1e678080b5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:04:02.137885 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-d31a3925-0483-4eee-965e-8e1e678080b5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:04:02.145600 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-d31a3925-0483-4eee-965e-8e1e678080b5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:04:02.147083 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-d31a3925-0483-4eee-965e-8e1e678080b5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:04:02.148208 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-d31a3925-0483-4eee-965e-8e1e678080b5 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1715 microversion: 2.20 time: 0.167182 Aug 07 05:04:02.148759 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 557/1156] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:04:01 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1715 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 05:04:16.394302 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [req-fbb0de65-0ba3-4f7b-9833-8fc6a94b0fa1 req-bab31e73-7d37-4352-838a-6fe800ab18a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0921101-facb-43a4-addf-1c9791448743", "tag": "018d5d66-f848-4b34-9a5e-9f813a6e1b80"}]} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:04:16.395765 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 05:04:16.395765 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: warnings.warn(msg) Aug 07 05:04:16.399425 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-899ab872-c7ff-482d-8388-abf80da2e6e6 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:04:16.399918 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-899ab872-c7ff-482d-8388-abf80da2e6e6 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] [instance: c0921101-facb-43a4-addf-1c9791448743] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:04:16.403211 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-fbb0de65-0ba3-4f7b-9833-8fc6a94b0fa1 req-bab31e73-7d37-4352-838a-6fe800ab18a6 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:04:16.403211 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-fbb0de65-0ba3-4f7b-9833-8fc6a94b0fa1 req-bab31e73-7d37-4352-838a-6fe800ab18a6 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:04:16.407547 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-899ab872-c7ff-482d-8388-abf80da2e6e6 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:04:16.407990 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-899ab872-c7ff-482d-8388-abf80da2e6e6 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:04:16.409042 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-899ab872-c7ff-482d-8388-abf80da2e6e6 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:04:16.409473 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-899ab872-c7ff-482d-8388-abf80da2e6e6 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:04:16.415900 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.compute.server_external_events [req-fbb0de65-0ba3-4f7b-9833-8fc6a94b0fa1 req-bab31e73-7d37-4352-838a-6fe800ab18a6 service nova] Creating event network-changed:018d5d66-f848-4b34-9a5e-9f813a6e1b80 for instance c0921101-facb-43a4-addf-1c9791448743 on hv-cinder-80374 Aug 07 05:04:16.422564 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [req-fbb0de65-0ba3-4f7b-9833-8fc6a94b0fa1 req-bab31e73-7d37-4352-838a-6fe800ab18a6 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031986 Aug 07 05:04:16.423156 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 558/1157] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 05:04:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 05:04:16.436965 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-899ab872-c7ff-482d-8388-abf80da2e6e6 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] [instance: c0921101-facb-43a4-addf-1c9791448743] Going to try to terminate instance {{(pid=107486) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 07 05:04:16.519590 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-899ab872-c7ff-482d-8388-abf80da2e6e6 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] 10.222.0.35 "DELETE /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743" status: 204 len: 0 microversion: 2.1 time: 0.134170 Aug 07 05:04:16.520187 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 600/1158] 10.222.0.35 () {58 vars in 1239 bytes} [Sat Aug 7 05:04:16 2021] DELETE /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 05:04:16.531450 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-ddaf37a8-da84-4d5c-9ea6-9b66ec8fe33c tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:04:16.534023 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-ddaf37a8-da84-4d5c-9ea6-9b66ec8fe33c tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] [instance: c0921101-facb-43a4-addf-1c9791448743] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:04:16.540542 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ddaf37a8-da84-4d5c-9ea6-9b66ec8fe33c tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:04:16.541246 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ddaf37a8-da84-4d5c-9ea6-9b66ec8fe33c tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:04:16.542198 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ddaf37a8-da84-4d5c-9ea6-9b66ec8fe33c tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:04:16.542790 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ddaf37a8-da84-4d5c-9ea6-9b66ec8fe33c tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:04:16.775123 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-ddaf37a8-da84-4d5c-9ea6-9b66ec8fe33c tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fec41eb8ba14082b33f628c86fe48c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874042788a343ec976046e4394fa45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:04:16.782818 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-ddaf37a8-da84-4d5c-9ea6-9b66ec8fe33c tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] 10.222.0.35 "GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743" status: 200 len: 1568 microversion: 2.1 time: 0.257181 Aug 07 05:04:16.783393 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 559/1159] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:04:16 2021] GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743 => generated 1568 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:04:17.801307 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-23e63b1b-c397-4e5b-8a97-bf83bcbd797a tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:04:17.802001 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-23e63b1b-c397-4e5b-8a97-bf83bcbd797a tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] [instance: c0921101-facb-43a4-addf-1c9791448743] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:04:17.807832 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-23e63b1b-c397-4e5b-8a97-bf83bcbd797a tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:04:17.808275 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-23e63b1b-c397-4e5b-8a97-bf83bcbd797a tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:04:17.809059 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-23e63b1b-c397-4e5b-8a97-bf83bcbd797a tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:04:17.809491 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-23e63b1b-c397-4e5b-8a97-bf83bcbd797a tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:04:17.929917 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-23e63b1b-c397-4e5b-8a97-bf83bcbd797a tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fec41eb8ba14082b33f628c86fe48c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874042788a343ec976046e4394fa45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:04:17.937833 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-23e63b1b-c397-4e5b-8a97-bf83bcbd797a tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] 10.222.0.35 "GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743" status: 200 len: 1449 microversion: 2.1 time: 0.140656 Aug 07 05:04:17.938402 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 601/1160] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:04:17 2021] GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743 => generated 1449 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:04:18.955216 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-c01ecfd2-c6d0-4005-ba56-e3c547616f67 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:04:18.956080 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-c01ecfd2-c6d0-4005-ba56-e3c547616f67 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] [instance: c0921101-facb-43a4-addf-1c9791448743] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:04:18.961897 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c01ecfd2-c6d0-4005-ba56-e3c547616f67 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:04:18.962335 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c01ecfd2-c6d0-4005-ba56-e3c547616f67 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:04:18.963098 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c01ecfd2-c6d0-4005-ba56-e3c547616f67 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:04:18.963527 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c01ecfd2-c6d0-4005-ba56-e3c547616f67 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:04:19.030860 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-c01ecfd2-c6d0-4005-ba56-e3c547616f67 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fec41eb8ba14082b33f628c86fe48c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874042788a343ec976046e4394fa45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:04:19.038285 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-c01ecfd2-c6d0-4005-ba56-e3c547616f67 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] 10.222.0.35 "GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743" status: 200 len: 1382 microversion: 2.1 time: 0.087547 Aug 07 05:04:19.038854 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 560/1161] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:04:18 2021] GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743 => generated 1382 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:04:19.099506 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [req-0bb1fb5d-f813-47ff-8dc2-d5d72986eadb req-16fa2a4b-ce3a-4e36-9ba1-056e319b6748 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0921101-facb-43a4-addf-1c9791448743", "name": "network-vif-deleted", "tag": "018d5d66-f848-4b34-9a5e-9f813a6e1b80"}]} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:04:19.101627 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 05:04:19.101627 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: warnings.warn(msg) Aug 07 05:04:19.109703 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-0bb1fb5d-f813-47ff-8dc2-d5d72986eadb req-16fa2a4b-ce3a-4e36-9ba1-056e319b6748 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:04:19.110140 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-0bb1fb5d-f813-47ff-8dc2-d5d72986eadb req-16fa2a4b-ce3a-4e36-9ba1-056e319b6748 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:04:19.121089 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.compute.server_external_events [req-0bb1fb5d-f813-47ff-8dc2-d5d72986eadb req-16fa2a4b-ce3a-4e36-9ba1-056e319b6748 service nova] Creating event network-vif-deleted:018d5d66-f848-4b34-9a5e-9f813a6e1b80 for instance c0921101-facb-43a4-addf-1c9791448743 on hv-cinder-80374 Aug 07 05:04:19.126955 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [req-0bb1fb5d-f813-47ff-8dc2-d5d72986eadb req-16fa2a4b-ce3a-4e36-9ba1-056e319b6748 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030723 Aug 07 05:04:19.128131 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 602/1162] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 05:04:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 05:04:20.055263 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-d50b9803-5672-456a-811b-ef3f65ba2920 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:04:20.055870 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-d50b9803-5672-456a-811b-ef3f65ba2920 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] [instance: c0921101-facb-43a4-addf-1c9791448743] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:04:20.061713 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d50b9803-5672-456a-811b-ef3f65ba2920 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:04:20.062920 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d50b9803-5672-456a-811b-ef3f65ba2920 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:04:20.063698 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d50b9803-5672-456a-811b-ef3f65ba2920 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:04:20.064128 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d50b9803-5672-456a-811b-ef3f65ba2920 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:04:20.095721 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d50b9803-5672-456a-811b-ef3f65ba2920 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:04:20.096162 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d50b9803-5672-456a-811b-ef3f65ba2920 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:04:20.096609 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.objects.instance [None req-d50b9803-5672-456a-811b-ef3f65ba2920 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lazy-loading 'fault' on Instance uuid c0921101-facb-43a4-addf-1c9791448743 {{(pid=107485) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 05:04:20.139814 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-d50b9803-5672-456a-811b-ef3f65ba2920 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fec41eb8ba14082b33f628c86fe48c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874042788a343ec976046e4394fa45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:04:20.146523 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-d50b9803-5672-456a-811b-ef3f65ba2920 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] 10.222.0.35 "GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743" status: 200 len: 1178 microversion: 2.1 time: 0.095070 Aug 07 05:04:20.147092 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 561/1163] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:04:20 2021] GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743 => generated 1178 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:04:21.163762 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-a699b6bc-32e6-4ff3-a78f-f601bedbe8d8 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:04:21.164380 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-a699b6bc-32e6-4ff3-a78f-f601bedbe8d8 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] [instance: c0921101-facb-43a4-addf-1c9791448743] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:04:21.170466 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a699b6bc-32e6-4ff3-a78f-f601bedbe8d8 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:04:21.170914 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a699b6bc-32e6-4ff3-a78f-f601bedbe8d8 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:04:21.171807 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a699b6bc-32e6-4ff3-a78f-f601bedbe8d8 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:04:21.172233 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a699b6bc-32e6-4ff3-a78f-f601bedbe8d8 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:04:21.185880 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.wsgi [None req-a699b6bc-32e6-4ff3-a78f-f601bedbe8d8 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] HTTP exception thrown: Instance c0921101-facb-43a4-addf-1c9791448743 could not be found. Aug 07 05:04:21.186457 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-a699b6bc-32e6-4ff3-a78f-f601bedbe8d8 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Returning 404 to user: Instance c0921101-facb-43a4-addf-1c9791448743 could not be found. {{(pid=107486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 07 05:04:21.187771 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-a699b6bc-32e6-4ff3-a78f-f601bedbe8d8 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] 10.222.0.35 "GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743" status: 404 len: 111 microversion: 2.1 time: 0.028107 Aug 07 05:04:21.188274 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 603/1164] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:04:21 2021] GET /compute/v2.1/servers/c0921101-facb-43a4-addf-1c9791448743 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 05:04:21.341754 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-7023aedc-9477-4674-b095-609b058ae404 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] Calling method '.version_select at 0x7f75ebf7c670>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:04:21.365714 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-7023aedc-9477-4674-b095-609b058ae404 tempest-TestShelveInstance-1443988270 tempest-TestShelveInstance-1443988270-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-516936065" status: 202 len: 0 microversion: 2.1 time: 0.027603 Aug 07 05:04:21.366321 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 562/1165] 10.222.0.35 () {58 vars in 1251 bytes} [Sat Aug 7 05:04:21 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-516936065 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 07 05:04:57.620123 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-13a121c6-17e8-4d8b-a09f-7d2e0e002fe3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:04:57.621054 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-13a121c6-17e8-4d8b-a09f-7d2e0e002fe3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:04:57.626976 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-13a121c6-17e8-4d8b-a09f-7d2e0e002fe3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:04:57.627420 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-13a121c6-17e8-4d8b-a09f-7d2e0e002fe3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:04:57.628178 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-13a121c6-17e8-4d8b-a09f-7d2e0e002fe3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:04:57.628606 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-13a121c6-17e8-4d8b-a09f-7d2e0e002fe3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:04:57.657436 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-13a121c6-17e8-4d8b-a09f-7d2e0e002fe3 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041270 Aug 07 05:04:57.657979 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 604/1166] 10.222.0.35 () {60 vars in 1343 bytes} [Sat Aug 7 05:04:57 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:04:57.718370 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-05b2ba61-0688-44db-9d61-feca950eb12f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:04:57.718876 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-05b2ba61-0688-44db-9d61-feca950eb12f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:04:57.724807 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-05b2ba61-0688-44db-9d61-feca950eb12f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:04:57.725270 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-05b2ba61-0688-44db-9d61-feca950eb12f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:04:57.726048 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-05b2ba61-0688-44db-9d61-feca950eb12f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:04:57.726476 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-05b2ba61-0688-44db-9d61-feca950eb12f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:04:57.751380 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-05b2ba61-0688-44db-9d61-feca950eb12f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Going to try to terminate instance {{(pid=107485) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 07 05:04:57.825503 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-05b2ba61-0688-44db-9d61-feca950eb12f tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "DELETE /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 204 len: 0 microversion: 2.20 time: 0.110641 Aug 07 05:04:57.827061 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 563/1167] 10.222.0.35 () {60 vars in 1280 bytes} [Sat Aug 7 05:04:57 2021] DELETE /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 07 05:04:57.835434 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-a1468eeb-8f79-4d3e-bea0-43a0e37c3051 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:04:57.836042 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-a1468eeb-8f79-4d3e-bea0-43a0e37c3051 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:04:57.842319 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a1468eeb-8f79-4d3e-bea0-43a0e37c3051 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:04:57.842763 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a1468eeb-8f79-4d3e-bea0-43a0e37c3051 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:04:57.843527 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a1468eeb-8f79-4d3e-bea0-43a0e37c3051 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:04:57.843959 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a1468eeb-8f79-4d3e-bea0-43a0e37c3051 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:04:57.963240 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-a1468eeb-8f79-4d3e-bea0-43a0e37c3051 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:04:57.971214 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-a1468eeb-8f79-4d3e-bea0-43a0e37c3051 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:04:57.972689 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-a1468eeb-8f79-4d3e-bea0-43a0e37c3051 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:04:57.973840 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-a1468eeb-8f79-4d3e-bea0-43a0e37c3051 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1721 microversion: 2.20 time: 0.142230 Aug 07 05:04:57.974391 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 605/1168] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:04:57 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1721 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 05:04:58.993410 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-230330ca-ed97-4085-bc48-c1317482c40e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:04:58.994092 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-230330ca-ed97-4085-bc48-c1317482c40e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:04:58.999952 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-230330ca-ed97-4085-bc48-c1317482c40e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:04:59.000387 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-230330ca-ed97-4085-bc48-c1317482c40e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:04:59.001164 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-230330ca-ed97-4085-bc48-c1317482c40e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:04:59.001587 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-230330ca-ed97-4085-bc48-c1317482c40e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:04:59.119459 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-230330ca-ed97-4085-bc48-c1317482c40e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:04:59.127798 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-230330ca-ed97-4085-bc48-c1317482c40e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:04:59.129349 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-230330ca-ed97-4085-bc48-c1317482c40e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:04:59.130472 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-230330ca-ed97-4085-bc48-c1317482c40e tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1721 microversion: 2.20 time: 0.141217 Aug 07 05:04:59.131112 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 564/1169] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:04:58 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1721 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 05:05:00.149358 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-8c94787b-e117-49fc-a814-1781cb887060 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:05:00.149960 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-8c94787b-e117-49fc-a814-1781cb887060 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:05:00.158112 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8c94787b-e117-49fc-a814-1781cb887060 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:00.162209 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8c94787b-e117-49fc-a814-1781cb887060 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:00.163356 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8c94787b-e117-49fc-a814-1781cb887060 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:00.163808 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8c94787b-e117-49fc-a814-1781cb887060 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:00.228629 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-8c94787b-e117-49fc-a814-1781cb887060 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:05:00.237807 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-8c94787b-e117-49fc-a814-1781cb887060 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:05:00.239297 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-8c94787b-e117-49fc-a814-1781cb887060 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f3bcbbebe354fe9a2a9ae24d7b792d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c23fa4998bf4a8cb6fa05e019c813bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:05:00.240439 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-8c94787b-e117-49fc-a814-1781cb887060 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 200 len: 1655 microversion: 2.20 time: 0.094800 Aug 07 05:05:00.241023 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 606/1170] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:05:00 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 1655 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 05:05:00.676942 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [req-c3114af3-1d61-4a06-9f02-aac32111d797 req-7bd414ce-68be-4a40-86b6-ef1f62b91467 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c28c4450-6a8b-4d0b-b175-29ed3a3b148c", "name": "network-vif-deleted", "tag": "92b05688-e614-4cbb-9a2c-05ff3d513b8a"}]} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:05:00.678626 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 05:05:00.678626 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: warnings.warn(msg) Aug 07 05:05:00.685896 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-c3114af3-1d61-4a06-9f02-aac32111d797 req-7bd414ce-68be-4a40-86b6-ef1f62b91467 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:00.686714 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-c3114af3-1d61-4a06-9f02-aac32111d797 req-7bd414ce-68be-4a40-86b6-ef1f62b91467 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:00.697793 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.compute.server_external_events [req-c3114af3-1d61-4a06-9f02-aac32111d797 req-7bd414ce-68be-4a40-86b6-ef1f62b91467 service nova] Creating event network-vif-deleted:92b05688-e614-4cbb-9a2c-05ff3d513b8a for instance c28c4450-6a8b-4d0b-b175-29ed3a3b148c on hv-cinder-80374 Aug 07 05:05:00.703105 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [req-c3114af3-1d61-4a06-9f02-aac32111d797 req-7bd414ce-68be-4a40-86b6-ef1f62b91467 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.247926 Aug 07 05:05:00.703768 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 565/1171] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 05:05:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 05:05:01.258718 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-047e1c34-03f1-407d-a1a9-7e77f9bdd0a2 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:05:01.259328 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-047e1c34-03f1-407d-a1a9-7e77f9bdd0a2 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:05:01.265638 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-047e1c34-03f1-407d-a1a9-7e77f9bdd0a2 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:01.266213 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-047e1c34-03f1-407d-a1a9-7e77f9bdd0a2 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:01.267063 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-047e1c34-03f1-407d-a1a9-7e77f9bdd0a2 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:01.267559 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-047e1c34-03f1-407d-a1a9-7e77f9bdd0a2 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:01.281664 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.wsgi [None req-047e1c34-03f1-407d-a1a9-7e77f9bdd0a2 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] HTTP exception thrown: Instance c28c4450-6a8b-4d0b-b175-29ed3a3b148c could not be found. Aug 07 05:05:01.282255 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-047e1c34-03f1-407d-a1a9-7e77f9bdd0a2 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Returning 404 to user: Instance c28c4450-6a8b-4d0b-b175-29ed3a3b148c could not be found. {{(pid=107486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 07 05:05:01.283099 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-047e1c34-03f1-407d-a1a9-7e77f9bdd0a2 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 404 len: 111 microversion: 2.20 time: 0.028441 Aug 07 05:05:01.283650 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 607/1172] 10.222.0.35 () {60 vars in 1277 bytes} [Sat Aug 7 05:05:01 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 07 05:05:01.292595 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-c89d9de6-8bfc-4aba-85d4-c388208a6af6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '.version_select at 0x7f75f81d5040>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:05:01.313598 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-c89d9de6-8bfc-4aba-85d4-c388208a6af6 tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-449470537" status: 204 len: 0 microversion: 2.20 time: 0.025022 Aug 07 05:05:01.314076 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 566/1173] 10.222.0.35 () {60 vars in 1259 bytes} [Sat Aug 7 05:05:01 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-449470537 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 07 05:05:03.068772 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-8c8ee55e-92eb-459c-80b0-a5d4340fb0fc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:05:03.069373 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-8c8ee55e-92eb-459c-80b0-a5d4340fb0fc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:05:03.075093 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8c8ee55e-92eb-459c-80b0-a5d4340fb0fc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:03.076187 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8c8ee55e-92eb-459c-80b0-a5d4340fb0fc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:03.077000 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8c8ee55e-92eb-459c-80b0-a5d4340fb0fc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:03.077434 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8c8ee55e-92eb-459c-80b0-a5d4340fb0fc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:03.091060 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.wsgi [None req-8c8ee55e-92eb-459c-80b0-a5d4340fb0fc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] HTTP exception thrown: Instance c28c4450-6a8b-4d0b-b175-29ed3a3b148c could not be found. Aug 07 05:05:03.091651 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-8c8ee55e-92eb-459c-80b0-a5d4340fb0fc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Returning 404 to user: Instance c28c4450-6a8b-4d0b-b175-29ed3a3b148c could not be found. {{(pid=107486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 07 05:05:03.092463 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-8c8ee55e-92eb-459c-80b0-a5d4340fb0fc tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "DELETE /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 404 len: 111 microversion: 2.1 time: 0.027419 Aug 07 05:05:03.093025 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 608/1174] 10.222.0.35 () {58 vars in 1239 bytes} [Sat Aug 7 05:05:03 2021] DELETE /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 05:05:03.100770 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-59384bfa-b627-4cd7-ad40-996718bfb80a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:05:03.101502 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-59384bfa-b627-4cd7-ad40-996718bfb80a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: c28c4450-6a8b-4d0b-b175-29ed3a3b148c] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:05:03.107556 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-59384bfa-b627-4cd7-ad40-996718bfb80a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:03.108166 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-59384bfa-b627-4cd7-ad40-996718bfb80a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:03.108968 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-59384bfa-b627-4cd7-ad40-996718bfb80a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:03.109400 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-59384bfa-b627-4cd7-ad40-996718bfb80a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:03.122155 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.wsgi [None req-59384bfa-b627-4cd7-ad40-996718bfb80a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] HTTP exception thrown: Instance c28c4450-6a8b-4d0b-b175-29ed3a3b148c could not be found. Aug 07 05:05:03.123369 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-59384bfa-b627-4cd7-ad40-996718bfb80a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Returning 404 to user: Instance c28c4450-6a8b-4d0b-b175-29ed3a3b148c could not be found. {{(pid=107485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 07 05:05:03.124179 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-59384bfa-b627-4cd7-ad40-996718bfb80a tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c" status: 404 len: 111 microversion: 2.1 time: 0.027086 Aug 07 05:05:03.124697 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 567/1175] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:05:03 2021] GET /compute/v2.1/servers/c28c4450-6a8b-4d0b-b175-29ed3a3b148c => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 05:05:04.257178 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-eb8972ff-03e8-423b-9cee-160f2e94d2cb tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:05:04.257661 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-eb8972ff-03e8-423b-9cee-160f2e94d2cb tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:05:04.263511 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-eb8972ff-03e8-423b-9cee-160f2e94d2cb tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:04.263946 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-eb8972ff-03e8-423b-9cee-160f2e94d2cb tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:04.264703 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-eb8972ff-03e8-423b-9cee-160f2e94d2cb tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:04.265159 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-eb8972ff-03e8-423b-9cee-160f2e94d2cb tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:04.278006 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.wsgi [None req-eb8972ff-03e8-423b-9cee-160f2e94d2cb tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] HTTP exception thrown: Instance 431857b6-a453-44f0-829c-00ed610d5fc2 could not be found. Aug 07 05:05:04.278790 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-eb8972ff-03e8-423b-9cee-160f2e94d2cb tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Returning 404 to user: Instance 431857b6-a453-44f0-829c-00ed610d5fc2 could not be found. {{(pid=107486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 07 05:05:04.279608 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-eb8972ff-03e8-423b-9cee-160f2e94d2cb tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "DELETE /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 404 len: 111 microversion: 2.1 time: 0.026065 Aug 07 05:05:04.280110 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 609/1176] 10.222.0.35 () {58 vars in 1239 bytes} [Sat Aug 7 05:05:04 2021] DELETE /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 05:05:04.287548 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-d7dd26db-d246-4933-a24b-f11ff847803b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:05:04.288154 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-d7dd26db-d246-4933-a24b-f11ff847803b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] [instance: 431857b6-a453-44f0-829c-00ed610d5fc2] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:05:04.293926 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d7dd26db-d246-4933-a24b-f11ff847803b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:04.294990 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d7dd26db-d246-4933-a24b-f11ff847803b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:04.295745 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d7dd26db-d246-4933-a24b-f11ff847803b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:04.296174 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d7dd26db-d246-4933-a24b-f11ff847803b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:04.308917 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.wsgi [None req-d7dd26db-d246-4933-a24b-f11ff847803b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] HTTP exception thrown: Instance 431857b6-a453-44f0-829c-00ed610d5fc2 could not be found. Aug 07 05:05:04.309487 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-d7dd26db-d246-4933-a24b-f11ff847803b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] Returning 404 to user: Instance 431857b6-a453-44f0-829c-00ed610d5fc2 could not be found. {{(pid=107485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 07 05:05:04.310910 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-d7dd26db-d246-4933-a24b-f11ff847803b tempest-AttachVolumeShelveTestJSON-1709330170 tempest-AttachVolumeShelveTestJSON-1709330170-project] 10.222.0.35 "GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2" status: 404 len: 111 microversion: 2.1 time: 0.027000 Aug 07 05:05:04.311411 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 568/1177] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:05:04 2021] GET /compute/v2.1/servers/431857b6-a453-44f0-829c-00ed610d5fc2 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 05:05:12.931263 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-e4d3d7c1-490d-4f86-b6d0-d6197a12f770 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'create', calling method: .version_select at 0x7f75ebff4c10>, body: {"keypair": {"name": "tempest-keypair-1624366041"}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:05:12.949511 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.quota [None req-e4d3d7c1-490d-4f86-b6d0-d6197a12f770 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Getting quotas for project 7a8063f2f6d64b79928f170fd6d99da8. Resources: {'key_pairs'} {{(pid=107486) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 07 05:05:12.954951 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.quota [None req-e4d3d7c1-490d-4f86-b6d0-d6197a12f770 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Getting quotas for user 5472ec0a0ae74e9bbf00e2bcf5db21c4 and project 7a8063f2f6d64b79928f170fd6d99da8. Resources: {'key_pairs'} {{(pid=107486) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 07 05:05:12.966905 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e4d3d7c1-490d-4f86-b6d0-d6197a12f770 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [7fa2029d-6165-42be-8823-0e98100d3e8e] AMQP server on 10.222.0.35:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 07 05:05:13.984025 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO oslo.messaging._drivers.impl_rabbit [None req-e4d3d7c1-490d-4f86-b6d0-d6197a12f770 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [7fa2029d-6165-42be-8823-0e98100d3e8e] Reconnected to AMQP server on 10.222.0.35:5672 via [amqp] client with port 54744. Aug 07 05:05:14.226062 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.quota [None req-e4d3d7c1-490d-4f86-b6d0-d6197a12f770 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Getting quotas for project 7a8063f2f6d64b79928f170fd6d99da8. Resources: {'key_pairs'} {{(pid=107486) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 07 05:05:14.230043 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.quota [None req-e4d3d7c1-490d-4f86-b6d0-d6197a12f770 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Getting quotas for user 5472ec0a0ae74e9bbf00e2bcf5db21c4 and project 7a8063f2f6d64b79928f170fd6d99da8. Resources: {'key_pairs'} {{(pid=107486) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 07 05:05:14.245966 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-e4d3d7c1-490d-4f86-b6d0-d6197a12f770 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 1.422080 Aug 07 05:05:14.246867 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 610/1178] 10.222.0.35 () {60 vars in 1158 bytes} [Sat Aug 7 05:05:12 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 1423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:05:15.660345 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b2f3e8fe-f2eb-433e-81aa-98acf8a082e1] AMQP server on 10.222.0.35:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 07 05:05:15.663984 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-82b06e4a-1556-4aa0-9392-1512a29c5954 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1359450506", "imageRef": "ddcf95b5-3ea4-4a61-8f54-4b2feadb8682", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7b8fc873-e06a-4d98-b60f-c7f19b5cc694"}], "security_groups": [{"name": "tempest-securitygroup--905634782"}], "key_name": "tempest-keypair-1624366041", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:05:15.761190 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.network.neutron [None req-82b06e4a-1556-4aa0-9392-1512a29c5954 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] validate_networks() for [('7b8fc873-e06a-4d98-b60f-c7f19b5cc694', None, None, None)] {{(pid=107485) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 07 05:05:16.190186 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.virt.hardware [None req-82b06e4a-1556-4aa0-9392-1512a29c5954 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Flavor limits 0:0:0 {{(pid=107485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 05:05:16.190607 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.virt.hardware [None req-82b06e4a-1556-4aa0-9392-1512a29c5954 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Image limits 0:0:0 {{(pid=107485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 05:05:16.191074 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.virt.hardware [None req-82b06e4a-1556-4aa0-9392-1512a29c5954 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Flavor pref 0:0:0 {{(pid=107485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 05:05:16.191473 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.virt.hardware [None req-82b06e4a-1556-4aa0-9392-1512a29c5954 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Image pref 0:0:0 {{(pid=107485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 05:05:16.191874 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.virt.hardware [None req-82b06e4a-1556-4aa0-9392-1512a29c5954 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 05:05:16.200391 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-82b06e4a-1556-4aa0-9392-1512a29c5954 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:16.200856 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-82b06e4a-1556-4aa0-9392-1512a29c5954 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:16.201653 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-82b06e4a-1556-4aa0-9392-1512a29c5954 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:16.202160 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-82b06e4a-1556-4aa0-9392-1512a29c5954 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:16.217971 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.quota [None req-82b06e4a-1556-4aa0-9392-1512a29c5954 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Getting quotas for project 7a8063f2f6d64b79928f170fd6d99da8. Resources: {'ram', 'cores', 'instances'} {{(pid=107485) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 07 05:05:16.221755 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.quota [None req-82b06e4a-1556-4aa0-9392-1512a29c5954 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Getting quotas for user 5472ec0a0ae74e9bbf00e2bcf5db21c4 and project 7a8063f2f6d64b79928f170fd6d99da8. Resources: {'ram', 'cores', 'instances'} {{(pid=107485) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 07 05:05:16.231912 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-82b06e4a-1556-4aa0-9392-1512a29c5954 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Going to run 1 instances... {{(pid=107485) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 07 05:05:16.234794 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-82b06e4a-1556-4aa0-9392-1512a29c5954 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ddcf95b5-3ea4-4a61-8f54-4b2feadb8682',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107485) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 07 05:05:16.280560 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-82b06e4a-1556-4aa0-9392-1512a29c5954 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.621475 Aug 07 05:05:16.281215 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 569/1179] 10.222.0.35 () {60 vars in 1147 bytes} [Sat Aug 7 05:05:15 2021] POST /compute/v2.1/servers => generated 401 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 07 05:05:16.290894 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-92c584fd-7a96-479f-846b-d46d5d94e51e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:05:16.291497 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-92c584fd-7a96-479f-846b-d46d5d94e51e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:05:16.345479 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-92c584fd-7a96-479f-846b-d46d5d94e51e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5472ec0a0ae74e9bbf00e2bcf5db21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8063f2f6d64b79928f170fd6d99da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:05:16.351919 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-92c584fd-7a96-479f-846b-d46d5d94e51e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186" status: 200 len: 1238 microversion: 2.1 time: 0.064695 Aug 07 05:05:16.352473 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 611/1180] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:05:16 2021] GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186 => generated 1238 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:05:17.369491 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-53ae7014-2a07-42ec-ad96-907ac1d1afd7 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:05:17.370104 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-53ae7014-2a07-42ec-ad96-907ac1d1afd7 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:05:17.387441 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-53ae7014-2a07-42ec-ad96-907ac1d1afd7 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:17.387889 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-53ae7014-2a07-42ec-ad96-907ac1d1afd7 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:17.389366 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-53ae7014-2a07-42ec-ad96-907ac1d1afd7 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:17.389863 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-53ae7014-2a07-42ec-ad96-907ac1d1afd7 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:17.408860 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO oslo.messaging._drivers.impl_rabbit [-] [b2f3e8fe-f2eb-433e-81aa-98acf8a082e1] Reconnected to AMQP server on 10.222.0.35:5672 via [amqp] client with port 54788. Aug 07 05:05:17.479469 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-53ae7014-2a07-42ec-ad96-907ac1d1afd7 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5472ec0a0ae74e9bbf00e2bcf5db21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8063f2f6d64b79928f170fd6d99da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:05:17.488874 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-53ae7014-2a07-42ec-ad96-907ac1d1afd7 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186" status: 200 len: 1298 microversion: 2.1 time: 0.123139 Aug 07 05:05:17.489678 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 570/1181] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:05:17 2021] GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186 => generated 1298 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:05:18.506112 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-97fdec1a-0a03-47ea-b0f3-d4ed0f280562 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:05:18.506728 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-97fdec1a-0a03-47ea-b0f3-d4ed0f280562 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:05:18.512595 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-97fdec1a-0a03-47ea-b0f3-d4ed0f280562 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:18.513078 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-97fdec1a-0a03-47ea-b0f3-d4ed0f280562 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:18.513857 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-97fdec1a-0a03-47ea-b0f3-d4ed0f280562 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:18.514292 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-97fdec1a-0a03-47ea-b0f3-d4ed0f280562 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:18.652880 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-97fdec1a-0a03-47ea-b0f3-d4ed0f280562 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5472ec0a0ae74e9bbf00e2bcf5db21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8063f2f6d64b79928f170fd6d99da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:05:18.664041 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-97fdec1a-0a03-47ea-b0f3-d4ed0f280562 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186" status: 200 len: 1363 microversion: 2.1 time: 0.161601 Aug 07 05:05:18.676150 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 612/1182] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:05:18 2021] GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:05:18.822706 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [req-df87f053-bb69-4e6e-a895-f7ef75338c1a req-31afbf19-b0f5-4098-b2d1-1c3c55d446e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3ca5865-7170-4012-b7fa-3c65e878a186", "tag": "0b0cfcc6-8a0f-4a90-98ec-937bbc471bc2"}]} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:05:18.824466 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 05:05:18.824466 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: warnings.warn(msg) Aug 07 05:05:18.835723 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-df87f053-bb69-4e6e-a895-f7ef75338c1a req-31afbf19-b0f5-4098-b2d1-1c3c55d446e0 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:18.836173 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-df87f053-bb69-4e6e-a895-f7ef75338c1a req-31afbf19-b0f5-4098-b2d1-1c3c55d446e0 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:18.852821 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.compute.server_external_events [req-df87f053-bb69-4e6e-a895-f7ef75338c1a req-31afbf19-b0f5-4098-b2d1-1c3c55d446e0 service nova] Creating event network-changed:0b0cfcc6-8a0f-4a90-98ec-937bbc471bc2 for instance e3ca5865-7170-4012-b7fa-3c65e878a186 on hv-cinder-80374 Aug 07 05:05:18.859757 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [req-df87f053-bb69-4e6e-a895-f7ef75338c1a req-31afbf19-b0f5-4098-b2d1-1c3c55d446e0 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040704 Aug 07 05:05:18.860361 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 571/1183] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 05:05:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 05:05:19.682656 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-41f91da0-4682-4c27-a1ce-1109354f5a03 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:05:19.683318 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-41f91da0-4682-4c27-a1ce-1109354f5a03 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:05:19.690187 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-41f91da0-4682-4c27-a1ce-1109354f5a03 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:19.690629 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-41f91da0-4682-4c27-a1ce-1109354f5a03 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:19.691424 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-41f91da0-4682-4c27-a1ce-1109354f5a03 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:19.691841 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-41f91da0-4682-4c27-a1ce-1109354f5a03 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:19.815169 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-41f91da0-4682-4c27-a1ce-1109354f5a03 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5472ec0a0ae74e9bbf00e2bcf5db21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8063f2f6d64b79928f170fd6d99da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:05:19.822568 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-41f91da0-4682-4c27-a1ce-1109354f5a03 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186" status: 200 len: 1363 microversion: 2.1 time: 0.143580 Aug 07 05:05:19.823130 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 613/1184] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:05:19 2021] GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186 => generated 1363 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:05:20.839789 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-4723d234-284d-4ac6-a300-cd1aaa5019fb tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:05:20.840485 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-4723d234-284d-4ac6-a300-cd1aaa5019fb tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:05:20.847238 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4723d234-284d-4ac6-a300-cd1aaa5019fb tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:20.847690 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4723d234-284d-4ac6-a300-cd1aaa5019fb tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:20.848453 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4723d234-284d-4ac6-a300-cd1aaa5019fb tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:20.848914 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4723d234-284d-4ac6-a300-cd1aaa5019fb tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:20.969813 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-4723d234-284d-4ac6-a300-cd1aaa5019fb tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5472ec0a0ae74e9bbf00e2bcf5db21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8063f2f6d64b79928f170fd6d99da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:05:20.977158 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-4723d234-284d-4ac6-a300-cd1aaa5019fb tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186" status: 200 len: 1363 microversion: 2.1 time: 0.141389 Aug 07 05:05:20.977719 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 572/1185] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:05:20 2021] GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186 => generated 1363 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:05:21.993034 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-ffd3a4b8-aa95-49b9-b10a-ab28289f7e42 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:05:21.993639 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-ffd3a4b8-aa95-49b9-b10a-ab28289f7e42 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:05:21.999829 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ffd3a4b8-aa95-49b9-b10a-ab28289f7e42 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:22.000263 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ffd3a4b8-aa95-49b9-b10a-ab28289f7e42 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:22.001056 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ffd3a4b8-aa95-49b9-b10a-ab28289f7e42 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:22.001483 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ffd3a4b8-aa95-49b9-b10a-ab28289f7e42 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:22.123472 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-ffd3a4b8-aa95-49b9-b10a-ab28289f7e42 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5472ec0a0ae74e9bbf00e2bcf5db21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8063f2f6d64b79928f170fd6d99da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:05:22.130681 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-ffd3a4b8-aa95-49b9-b10a-ab28289f7e42 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186" status: 200 len: 1363 microversion: 2.1 time: 0.141259 Aug 07 05:05:22.131243 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 614/1186] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:05:21 2021] GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186 => generated 1363 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:05:23.147265 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-d26fc1e3-21c7-489c-83d7-824433f8ae68 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:05:23.147880 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-d26fc1e3-21c7-489c-83d7-824433f8ae68 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:05:23.153599 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d26fc1e3-21c7-489c-83d7-824433f8ae68 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:23.154104 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d26fc1e3-21c7-489c-83d7-824433f8ae68 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:23.155103 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d26fc1e3-21c7-489c-83d7-824433f8ae68 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:23.155544 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d26fc1e3-21c7-489c-83d7-824433f8ae68 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:23.277259 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-d26fc1e3-21c7-489c-83d7-824433f8ae68 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5472ec0a0ae74e9bbf00e2bcf5db21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8063f2f6d64b79928f170fd6d99da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:05:23.285319 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-d26fc1e3-21c7-489c-83d7-824433f8ae68 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186" status: 200 len: 1363 microversion: 2.1 time: 0.141771 Aug 07 05:05:23.286142 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 573/1187] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:05:23 2021] GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186 => generated 1363 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 05:05:24.301839 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-a1aa1da4-3504-459b-8f18-365f66b3c509 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:05:24.302448 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-a1aa1da4-3504-459b-8f18-365f66b3c509 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:05:24.308281 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a1aa1da4-3504-459b-8f18-365f66b3c509 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:24.308724 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a1aa1da4-3504-459b-8f18-365f66b3c509 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:24.309526 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a1aa1da4-3504-459b-8f18-365f66b3c509 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:24.309956 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a1aa1da4-3504-459b-8f18-365f66b3c509 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:24.432314 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-a1aa1da4-3504-459b-8f18-365f66b3c509 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5472ec0a0ae74e9bbf00e2bcf5db21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8063f2f6d64b79928f170fd6d99da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:05:24.439608 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-a1aa1da4-3504-459b-8f18-365f66b3c509 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186" status: 200 len: 1363 microversion: 2.1 time: 0.141735 Aug 07 05:05:24.440158 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 615/1188] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:05:24 2021] GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186 => generated 1363 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:05:25.376935 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [req-0bf9e491-197d-4d34-8c2d-50393228b32f req-36d185b2-dacd-46bd-9c47-c10fd25f0791 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3ca5865-7170-4012-b7fa-3c65e878a186", "name": "network-vif-plugged", "status": "completed", "tag": "0b0cfcc6-8a0f-4a90-98ec-937bbc471bc2"}]} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:05:25.378457 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 05:05:25.378457 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: warnings.warn(msg) Aug 07 05:05:25.385231 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-0bf9e491-197d-4d34-8c2d-50393228b32f req-36d185b2-dacd-46bd-9c47-c10fd25f0791 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:25.385668 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-0bf9e491-197d-4d34-8c2d-50393228b32f req-36d185b2-dacd-46bd-9c47-c10fd25f0791 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:25.397033 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.compute.server_external_events [req-0bf9e491-197d-4d34-8c2d-50393228b32f req-36d185b2-dacd-46bd-9c47-c10fd25f0791 service nova] Creating event network-vif-plugged:0b0cfcc6-8a0f-4a90-98ec-937bbc471bc2 for instance e3ca5865-7170-4012-b7fa-3c65e878a186 on hv-cinder-80374 Aug 07 05:05:25.401887 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [req-0bf9e491-197d-4d34-8c2d-50393228b32f req-36d185b2-dacd-46bd-9c47-c10fd25f0791 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087049 Aug 07 05:05:25.402512 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 574/1189] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 05:05:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 05:05:25.456251 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-ddcd346f-5c0f-4b77-91d1-1a01ffd01fc8 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:05:25.456888 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-ddcd346f-5c0f-4b77-91d1-1a01ffd01fc8 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:05:25.463264 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ddcd346f-5c0f-4b77-91d1-1a01ffd01fc8 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:25.463902 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ddcd346f-5c0f-4b77-91d1-1a01ffd01fc8 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:25.464752 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ddcd346f-5c0f-4b77-91d1-1a01ffd01fc8 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:25.465224 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ddcd346f-5c0f-4b77-91d1-1a01ffd01fc8 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:25.589190 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-ddcd346f-5c0f-4b77-91d1-1a01ffd01fc8 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5472ec0a0ae74e9bbf00e2bcf5db21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8063f2f6d64b79928f170fd6d99da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:05:25.596594 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-ddcd346f-5c0f-4b77-91d1-1a01ffd01fc8 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186" status: 200 len: 1363 microversion: 2.1 time: 0.145104 Aug 07 05:05:25.597181 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 616/1190] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:05:25 2021] GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186 => generated 1363 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:05:26.613988 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-52a6be96-0afd-4a48-bf6d-d1e3ec4178aa tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:05:26.614706 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-52a6be96-0afd-4a48-bf6d-d1e3ec4178aa tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:05:26.620764 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-52a6be96-0afd-4a48-bf6d-d1e3ec4178aa tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:26.621231 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-52a6be96-0afd-4a48-bf6d-d1e3ec4178aa tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:26.621988 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-52a6be96-0afd-4a48-bf6d-d1e3ec4178aa tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:26.622414 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-52a6be96-0afd-4a48-bf6d-d1e3ec4178aa tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:26.740750 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-52a6be96-0afd-4a48-bf6d-d1e3ec4178aa tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5472ec0a0ae74e9bbf00e2bcf5db21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8063f2f6d64b79928f170fd6d99da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:05:26.747841 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-52a6be96-0afd-4a48-bf6d-d1e3ec4178aa tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186" status: 200 len: 1363 microversion: 2.1 time: 0.137909 Aug 07 05:05:26.748484 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 575/1191] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:05:26 2021] GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186 => generated 1363 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:05:27.764273 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-a5bc6d5d-6fcb-46ff-b73f-b8e6621f657c tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:05:27.764896 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-a5bc6d5d-6fcb-46ff-b73f-b8e6621f657c tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:05:27.770778 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a5bc6d5d-6fcb-46ff-b73f-b8e6621f657c tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:27.771291 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a5bc6d5d-6fcb-46ff-b73f-b8e6621f657c tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:27.772044 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a5bc6d5d-6fcb-46ff-b73f-b8e6621f657c tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:27.772474 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a5bc6d5d-6fcb-46ff-b73f-b8e6621f657c tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:27.889894 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-a5bc6d5d-6fcb-46ff-b73f-b8e6621f657c tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5472ec0a0ae74e9bbf00e2bcf5db21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8063f2f6d64b79928f170fd6d99da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:05:27.897046 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-a5bc6d5d-6fcb-46ff-b73f-b8e6621f657c tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186" status: 200 len: 1549 microversion: 2.1 time: 0.136399 Aug 07 05:05:27.897603 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 617/1192] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:05:27 2021] GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186 => generated 1549 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:05:27.913957 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-656021f0-dee0-420d-ae53-9e5ce86dfbb6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:05:27.914522 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-656021f0-dee0-420d-ae53-9e5ce86dfbb6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:05:27.921700 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-656021f0-dee0-420d-ae53-9e5ce86dfbb6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:27.922141 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-656021f0-dee0-420d-ae53-9e5ce86dfbb6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:27.922901 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-656021f0-dee0-420d-ae53-9e5ce86dfbb6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:27.923327 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-656021f0-dee0-420d-ae53-9e5ce86dfbb6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:27.999437 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-656021f0-dee0-420d-ae53-9e5ce86dfbb6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089395 Aug 07 05:05:28.000023 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 576/1193] 10.222.0.35 () {58 vars in 1275 bytes} [Sat Aug 7 05:05:27 2021] GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 05:05:29.178706 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-9d845f8d-61ec-4916-8fce-0bef9e16e38a tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:05:29.179732 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-9d845f8d-61ec-4916-8fce-0bef9e16e38a tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:05:29.181873 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [req-52045776-2da2-4990-a3f3-0abab9d858c0 req-d2254e7d-3aa4-4cb3-a3eb-9e8414ae0bdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3ca5865-7170-4012-b7fa-3c65e878a186", "tag": "0b0cfcc6-8a0f-4a90-98ec-937bbc471bc2"}]} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:05:29.183534 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 05:05:29.183534 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: warnings.warn(msg) Aug 07 05:05:29.186102 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9d845f8d-61ec-4916-8fce-0bef9e16e38a tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:29.186544 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9d845f8d-61ec-4916-8fce-0bef9e16e38a tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:29.187318 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9d845f8d-61ec-4916-8fce-0bef9e16e38a tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:29.187743 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9d845f8d-61ec-4916-8fce-0bef9e16e38a tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:29.191095 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-52045776-2da2-4990-a3f3-0abab9d858c0 req-d2254e7d-3aa4-4cb3-a3eb-9e8414ae0bdc service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:29.191544 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-52045776-2da2-4990-a3f3-0abab9d858c0 req-d2254e7d-3aa4-4cb3-a3eb-9e8414ae0bdc service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:29.203291 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.compute.server_external_events [req-52045776-2da2-4990-a3f3-0abab9d858c0 req-d2254e7d-3aa4-4cb3-a3eb-9e8414ae0bdc service nova] Creating event network-changed:0b0cfcc6-8a0f-4a90-98ec-937bbc471bc2 for instance e3ca5865-7170-4012-b7fa-3c65e878a186 on hv-cinder-80374 Aug 07 05:05:29.210498 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [req-52045776-2da2-4990-a3f3-0abab9d858c0 req-d2254e7d-3aa4-4cb3-a3eb-9e8414ae0bdc service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032281 Aug 07 05:05:29.211273 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 577/1194] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 05:05:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 05:05:29.299251 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-9d845f8d-61ec-4916-8fce-0bef9e16e38a tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 14 microversion: 2.1 time: 0.124084 Aug 07 05:05:29.302598 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 618/1195] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:05:29 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 14 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 05:05:30.311318 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-568a525e-e88d-41a1-b25f-4098ddf661f8 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:05:30.312530 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-568a525e-e88d-41a1-b25f-4098ddf661f8 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:05:30.318562 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-568a525e-e88d-41a1-b25f-4098ddf661f8 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:30.319013 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-568a525e-e88d-41a1-b25f-4098ddf661f8 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:30.319786 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-568a525e-e88d-41a1-b25f-4098ddf661f8 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:30.320221 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-568a525e-e88d-41a1-b25f-4098ddf661f8 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:30.401034 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-568a525e-e88d-41a1-b25f-4098ddf661f8 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 14 microversion: 2.1 time: 0.094168 Aug 07 05:05:30.401686 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 578/1196] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:05:30 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 05:05:30.980200 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-c45dd644-e9ce-4b76-8306-6a9676a8d364 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:05:30.980766 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-c45dd644-e9ce-4b76-8306-6a9676a8d364 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:05:30.987856 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c45dd644-e9ce-4b76-8306-6a9676a8d364 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:30.988291 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c45dd644-e9ce-4b76-8306-6a9676a8d364 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:30.989080 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c45dd644-e9ce-4b76-8306-6a9676a8d364 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:30.989508 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c45dd644-e9ce-4b76-8306-6a9676a8d364 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:31.014774 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-c45dd644-e9ce-4b76-8306-6a9676a8d364 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17] Going to try to terminate instance {{(pid=107486) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 07 05:05:31.089381 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-c45dd644-e9ce-4b76-8306-6a9676a8d364 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "DELETE /compute/v2.1/servers/5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17" status: 204 len: 0 microversion: 2.1 time: 0.112751 Aug 07 05:05:31.090252 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 619/1197] 10.222.0.35 () {58 vars in 1239 bytes} [Sat Aug 7 05:05:30 2021] DELETE /compute/v2.1/servers/5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 05:05:31.100853 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-979e908b-8577-4d62-b110-fc5d232c73ee tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:05:31.101556 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-979e908b-8577-4d62-b110-fc5d232c73ee tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:05:31.114818 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-979e908b-8577-4d62-b110-fc5d232c73ee tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:31.115273 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-979e908b-8577-4d62-b110-fc5d232c73ee tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:31.116190 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-979e908b-8577-4d62-b110-fc5d232c73ee tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:31.116640 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-979e908b-8577-4d62-b110-fc5d232c73ee tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:31.229803 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [req-e0a899b4-514b-462f-bedf-0d5fe85ab363 req-091e3c3c-104e-4aa0-ac25-bf124b5cc395 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17", "tag": "ce9c023e-3f65-4600-938f-4bbbb114a9b9"}]} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:05:31.231657 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 05:05:31.231657 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: warnings.warn(msg) Aug 07 05:05:31.239809 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-e0a899b4-514b-462f-bedf-0d5fe85ab363 req-091e3c3c-104e-4aa0-ac25-bf124b5cc395 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:31.240261 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-e0a899b4-514b-462f-bedf-0d5fe85ab363 req-091e3c3c-104e-4aa0-ac25-bf124b5cc395 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:31.250628 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-979e908b-8577-4d62-b110-fc5d232c73ee tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:05:31.253314 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.compute.server_external_events [req-e0a899b4-514b-462f-bedf-0d5fe85ab363 req-091e3c3c-104e-4aa0-ac25-bf124b5cc395 service nova] Creating event network-changed:ce9c023e-3f65-4600-938f-4bbbb114a9b9 for instance 5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17 on hv-cinder-80374 Aug 07 05:05:31.258184 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [req-e0a899b4-514b-462f-bedf-0d5fe85ab363 req-091e3c3c-104e-4aa0-ac25-bf124b5cc395 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032381 Aug 07 05:05:31.258805 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 620/1198] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 05:05:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 05:05:31.260099 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-979e908b-8577-4d62-b110-fc5d232c73ee tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17" status: 200 len: 1577 microversion: 2.1 time: 0.164873 Aug 07 05:05:31.261841 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 579/1199] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:05:31 2021] GET /compute/v2.1/servers/5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17 => generated 1577 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:05:31.412215 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-f5466b44-ebb6-410a-8721-46019419cfce tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:05:31.415565 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-f5466b44-ebb6-410a-8721-46019419cfce tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:05:31.422308 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f5466b44-ebb6-410a-8721-46019419cfce tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:31.422852 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f5466b44-ebb6-410a-8721-46019419cfce tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:31.423719 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f5466b44-ebb6-410a-8721-46019419cfce tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:31.424221 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f5466b44-ebb6-410a-8721-46019419cfce tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:31.509651 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-f5466b44-ebb6-410a-8721-46019419cfce tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 14 microversion: 2.1 time: 0.101285 Aug 07 05:05:31.514236 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 621/1200] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:05:31 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 05:05:32.278542 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-736b3f21-c9e1-476c-92a9-ada0d57a0837 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:05:32.279111 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-736b3f21-c9e1-476c-92a9-ada0d57a0837 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:05:32.285317 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-736b3f21-c9e1-476c-92a9-ada0d57a0837 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:32.285754 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-736b3f21-c9e1-476c-92a9-ada0d57a0837 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:32.286508 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-736b3f21-c9e1-476c-92a9-ada0d57a0837 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:32.286939 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-736b3f21-c9e1-476c-92a9-ada0d57a0837 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:32.405045 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-736b3f21-c9e1-476c-92a9-ada0d57a0837 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:05:32.412364 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-736b3f21-c9e1-476c-92a9-ada0d57a0837 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17" status: 200 len: 1458 microversion: 2.1 time: 0.137601 Aug 07 05:05:32.412952 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 580/1201] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:05:32 2021] GET /compute/v2.1/servers/5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17 => generated 1458 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:05:32.524618 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-3fcafd8c-05f5-4b28-89bc-3633900beec3 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:05:32.525679 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-3fcafd8c-05f5-4b28-89bc-3633900beec3 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:05:32.532967 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3fcafd8c-05f5-4b28-89bc-3633900beec3 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:32.533354 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3fcafd8c-05f5-4b28-89bc-3633900beec3 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:32.534139 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3fcafd8c-05f5-4b28-89bc-3633900beec3 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:32.534577 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3fcafd8c-05f5-4b28-89bc-3633900beec3 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:32.632063 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-3fcafd8c-05f5-4b28-89bc-3633900beec3 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 14 microversion: 2.1 time: 0.111781 Aug 07 05:05:32.635149 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 622/1202] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:05:32 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 05:05:33.430775 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-5a5a4760-80f1-4d59-80d0-5c786a93765a tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:05:33.431385 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-5a5a4760-80f1-4d59-80d0-5c786a93765a tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:05:33.437236 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5a5a4760-80f1-4d59-80d0-5c786a93765a tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:33.437690 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5a5a4760-80f1-4d59-80d0-5c786a93765a tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:33.438458 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5a5a4760-80f1-4d59-80d0-5c786a93765a tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:33.438889 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5a5a4760-80f1-4d59-80d0-5c786a93765a tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:33.633084 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-5a5a4760-80f1-4d59-80d0-5c786a93765a tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:05:33.643801 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-c1531ed5-3429-48d7-a7c1-f10b1bc06993 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:05:33.645101 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-c1531ed5-3429-48d7-a7c1-f10b1bc06993 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:05:33.645614 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-5a5a4760-80f1-4d59-80d0-5c786a93765a tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17" status: 200 len: 1458 microversion: 2.1 time: 0.218441 Aug 07 05:05:33.646381 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 581/1203] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:05:33 2021] GET /compute/v2.1/servers/5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17 => generated 1458 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:05:33.652276 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c1531ed5-3429-48d7-a7c1-f10b1bc06993 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:33.652717 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c1531ed5-3429-48d7-a7c1-f10b1bc06993 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:33.653540 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c1531ed5-3429-48d7-a7c1-f10b1bc06993 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:33.654015 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c1531ed5-3429-48d7-a7c1-f10b1bc06993 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:33.741207 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-c1531ed5-3429-48d7-a7c1-f10b1bc06993 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 14 microversion: 2.1 time: 0.102261 Aug 07 05:05:33.742175 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 623/1204] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:05:33 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 07 05:05:33.747554 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [req-761876c6-144a-4c7a-8548-09ff10073841 req-657f0f9b-69de-4b11-b560-67e0035cc600 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17", "name": "network-vif-deleted", "tag": "ce9c023e-3f65-4600-938f-4bbbb114a9b9"}]} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:05:33.750433 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 05:05:33.750433 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: warnings.warn(msg) Aug 07 05:05:33.757582 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-761876c6-144a-4c7a-8548-09ff10073841 req-657f0f9b-69de-4b11-b560-67e0035cc600 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:33.758021 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-761876c6-144a-4c7a-8548-09ff10073841 req-657f0f9b-69de-4b11-b560-67e0035cc600 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:33.770948 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.compute.server_external_events [req-761876c6-144a-4c7a-8548-09ff10073841 req-657f0f9b-69de-4b11-b560-67e0035cc600 service nova] Creating event network-vif-deleted:ce9c023e-3f65-4600-938f-4bbbb114a9b9 for instance 5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17 on hv-cinder-80374 Aug 07 05:05:33.775731 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [req-761876c6-144a-4c7a-8548-09ff10073841 req-657f0f9b-69de-4b11-b560-67e0035cc600 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032063 Aug 07 05:05:33.776336 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 582/1205] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 05:05:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 05:05:34.662828 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-37bb571a-b8a3-423a-9997-f35baab6e826 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:05:34.663518 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-37bb571a-b8a3-423a-9997-f35baab6e826 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:05:34.670500 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-37bb571a-b8a3-423a-9997-f35baab6e826 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:34.670982 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-37bb571a-b8a3-423a-9997-f35baab6e826 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:34.671772 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-37bb571a-b8a3-423a-9997-f35baab6e826 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:34.672200 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-37bb571a-b8a3-423a-9997-f35baab6e826 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:34.685106 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.wsgi [None req-37bb571a-b8a3-423a-9997-f35baab6e826 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] HTTP exception thrown: Instance 5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17 could not be found. Aug 07 05:05:34.686415 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-37bb571a-b8a3-423a-9997-f35baab6e826 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Returning 404 to user: Instance 5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17 could not be found. {{(pid=107486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 07 05:05:34.687009 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-37bb571a-b8a3-423a-9997-f35baab6e826 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17" status: 404 len: 111 microversion: 2.1 time: 0.028336 Aug 07 05:05:34.687518 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 624/1206] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:05:34 2021] GET /compute/v2.1/servers/5fe91f9f-3dd1-4f15-b6a7-8da826bb5f17 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 05:05:34.754075 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-cae32383-e523-4f34-9812-61e5a9762505 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:05:34.755113 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-cae32383-e523-4f34-9812-61e5a9762505 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:05:34.761285 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-cae32383-e523-4f34-9812-61e5a9762505 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:34.761736 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-cae32383-e523-4f34-9812-61e5a9762505 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:34.762503 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-cae32383-e523-4f34-9812-61e5a9762505 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:34.762937 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-cae32383-e523-4f34-9812-61e5a9762505 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:34.844925 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-cae32383-e523-4f34-9812-61e5a9762505 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 14 microversion: 2.1 time: 0.095212 Aug 07 05:05:34.845578 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 583/1207] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:05:34 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 05:05:35.859075 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-709815f4-f29c-4c92-a99c-d82a42777ebe tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:05:35.860716 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-709815f4-f29c-4c92-a99c-d82a42777ebe tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:05:35.869625 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-709815f4-f29c-4c92-a99c-d82a42777ebe tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:35.870279 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-709815f4-f29c-4c92-a99c-d82a42777ebe tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:35.871566 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-709815f4-f29c-4c92-a99c-d82a42777ebe tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:35.872262 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-709815f4-f29c-4c92-a99c-d82a42777ebe tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:35.977167 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-709815f4-f29c-4c92-a99c-d82a42777ebe tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 14 microversion: 2.1 time: 0.124264 Aug 07 05:05:35.977996 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 625/1208] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:05:35 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 14 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 05:05:36.987864 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-53642063-8d4b-46f4-9b32-8ee87728f38d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:05:36.988873 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-53642063-8d4b-46f4-9b32-8ee87728f38d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:05:36.995243 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-53642063-8d4b-46f4-9b32-8ee87728f38d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:36.995686 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-53642063-8d4b-46f4-9b32-8ee87728f38d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:36.996447 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-53642063-8d4b-46f4-9b32-8ee87728f38d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:36.996897 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-53642063-8d4b-46f4-9b32-8ee87728f38d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:37.095435 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-53642063-8d4b-46f4-9b32-8ee87728f38d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 14 microversion: 2.1 time: 0.111388 Aug 07 05:05:37.096111 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 584/1209] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:05:36 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 05:05:37.749814 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-b96c0fac-8901-4599-997d-78a8833e6519 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:05:37.755631 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [req-d9a77dfa-39c7-40bf-868e-d66287bc47c8 req-61751b49-ca77-458e-9ea6-b80b2628fc61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38aca19c-e68f-4376-82c7-9ba0111c9e85", "tag": "b3097a41-98dc-40cd-8944-3542f3ba37cb"}]} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:05:37.757135 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 05:05:37.757135 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: warnings.warn(msg) Aug 07 05:05:37.760852 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-b96c0fac-8901-4599-997d-78a8833e6519 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 38aca19c-e68f-4376-82c7-9ba0111c9e85] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:05:37.767555 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-d9a77dfa-39c7-40bf-868e-d66287bc47c8 req-61751b49-ca77-458e-9ea6-b80b2628fc61 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:37.767999 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-d9a77dfa-39c7-40bf-868e-d66287bc47c8 req-61751b49-ca77-458e-9ea6-b80b2628fc61 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:37.768389 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b96c0fac-8901-4599-997d-78a8833e6519 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:37.768882 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b96c0fac-8901-4599-997d-78a8833e6519 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:37.769669 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b96c0fac-8901-4599-997d-78a8833e6519 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:37.770102 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b96c0fac-8901-4599-997d-78a8833e6519 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:37.779181 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.compute.server_external_events [req-d9a77dfa-39c7-40bf-868e-d66287bc47c8 req-61751b49-ca77-458e-9ea6-b80b2628fc61 service nova] Creating event network-changed:b3097a41-98dc-40cd-8944-3542f3ba37cb for instance 38aca19c-e68f-4376-82c7-9ba0111c9e85 on hv-cinder-80374 Aug 07 05:05:37.784024 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [req-d9a77dfa-39c7-40bf-868e-d66287bc47c8 req-61751b49-ca77-458e-9ea6-b80b2628fc61 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032276 Aug 07 05:05:37.785000 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 585/1210] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 05:05:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 05:05:37.796915 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-b96c0fac-8901-4599-997d-78a8833e6519 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 38aca19c-e68f-4376-82c7-9ba0111c9e85] Going to try to terminate instance {{(pid=107486) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 07 05:05:37.878685 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-b96c0fac-8901-4599-997d-78a8833e6519 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "DELETE /compute/v2.1/servers/38aca19c-e68f-4376-82c7-9ba0111c9e85" status: 204 len: 0 microversion: 2.1 time: 0.133400 Aug 07 05:05:37.879326 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 626/1211] 10.222.0.35 () {58 vars in 1239 bytes} [Sat Aug 7 05:05:37 2021] DELETE /compute/v2.1/servers/38aca19c-e68f-4376-82c7-9ba0111c9e85 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 05:05:37.888338 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-f7109bc5-a054-4f17-b459-8bf075812e60 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:05:37.889840 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-f7109bc5-a054-4f17-b459-8bf075812e60 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 38aca19c-e68f-4376-82c7-9ba0111c9e85] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:05:37.896563 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f7109bc5-a054-4f17-b459-8bf075812e60 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:37.897345 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f7109bc5-a054-4f17-b459-8bf075812e60 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:37.898342 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f7109bc5-a054-4f17-b459-8bf075812e60 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:37.898964 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f7109bc5-a054-4f17-b459-8bf075812e60 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:38.103810 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-f7109bc5-a054-4f17-b459-8bf075812e60 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:05:38.106393 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-782a5aa6-b4ac-4232-89dd-a66ebe587e67 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:05:38.108896 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-782a5aa6-b4ac-4232-89dd-a66ebe587e67 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:05:38.116058 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-782a5aa6-b4ac-4232-89dd-a66ebe587e67 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:38.116713 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-f7109bc5-a054-4f17-b459-8bf075812e60 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/38aca19c-e68f-4376-82c7-9ba0111c9e85" status: 200 len: 1578 microversion: 2.1 time: 0.231780 Aug 07 05:05:38.116883 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-782a5aa6-b4ac-4232-89dd-a66ebe587e67 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:38.126697 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-782a5aa6-b4ac-4232-89dd-a66ebe587e67 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:38.126697 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-782a5aa6-b4ac-4232-89dd-a66ebe587e67 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:38.127821 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 586/1212] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:05:37 2021] GET /compute/v2.1/servers/38aca19c-e68f-4376-82c7-9ba0111c9e85 => generated 1578 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:05:38.210970 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-782a5aa6-b4ac-4232-89dd-a66ebe587e67 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 14 microversion: 2.1 time: 0.108577 Aug 07 05:05:38.211920 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 627/1213] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:05:38 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 07 05:05:39.133698 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-86cf388a-55ee-4a63-9564-877173134763 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:05:39.134311 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-86cf388a-55ee-4a63-9564-877173134763 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 38aca19c-e68f-4376-82c7-9ba0111c9e85] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:05:39.141257 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-86cf388a-55ee-4a63-9564-877173134763 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:39.141705 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-86cf388a-55ee-4a63-9564-877173134763 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:39.142471 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-86cf388a-55ee-4a63-9564-877173134763 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:39.142904 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-86cf388a-55ee-4a63-9564-877173134763 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:39.222739 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-1d9ad6e5-2faf-4571-aa0f-f89af2ec598f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:05:39.223734 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-1d9ad6e5-2faf-4571-aa0f-f89af2ec598f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:05:39.230521 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1d9ad6e5-2faf-4571-aa0f-f89af2ec598f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:39.230973 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1d9ad6e5-2faf-4571-aa0f-f89af2ec598f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:39.231753 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1d9ad6e5-2faf-4571-aa0f-f89af2ec598f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:39.232835 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1d9ad6e5-2faf-4571-aa0f-f89af2ec598f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:39.263748 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-86cf388a-55ee-4a63-9564-877173134763 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:05:39.271082 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-86cf388a-55ee-4a63-9564-877173134763 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/38aca19c-e68f-4376-82c7-9ba0111c9e85" status: 200 len: 1459 microversion: 2.1 time: 0.141147 Aug 07 05:05:39.271639 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 587/1214] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:05:39 2021] GET /compute/v2.1/servers/38aca19c-e68f-4376-82c7-9ba0111c9e85 => generated 1459 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 05:05:39.412026 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-1d9ad6e5-2faf-4571-aa0f-f89af2ec598f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 1800 microversion: 2.1 time: 0.193284 Aug 07 05:05:39.412576 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 628/1215] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:05:39 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 1800 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 05:05:40.123998 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [req-7f450b12-be96-4275-a41d-40563f1f82a6 req-5762e5c9-e1b4-4436-ba4a-67cacc37dd16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38aca19c-e68f-4376-82c7-9ba0111c9e85", "name": "network-vif-deleted", "tag": "b3097a41-98dc-40cd-8944-3542f3ba37cb"}]} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:05:40.125608 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 05:05:40.125608 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: warnings.warn(msg) Aug 07 05:05:40.132399 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-7f450b12-be96-4275-a41d-40563f1f82a6 req-5762e5c9-e1b4-4436-ba4a-67cacc37dd16 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:40.132872 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-7f450b12-be96-4275-a41d-40563f1f82a6 req-5762e5c9-e1b4-4436-ba4a-67cacc37dd16 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:40.144243 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.compute.server_external_events [req-7f450b12-be96-4275-a41d-40563f1f82a6 req-5762e5c9-e1b4-4436-ba4a-67cacc37dd16 service nova] Creating event network-vif-deleted:b3097a41-98dc-40cd-8944-3542f3ba37cb for instance 38aca19c-e68f-4376-82c7-9ba0111c9e85 on hv-cinder-80374 Aug 07 05:05:40.149085 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [req-7f450b12-be96-4275-a41d-40563f1f82a6 req-5762e5c9-e1b4-4436-ba4a-67cacc37dd16 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028686 Aug 07 05:05:40.149719 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 588/1216] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 05:05:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 05:05:40.288749 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-3bb7493a-6c11-4959-9011-369040e37ae5 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:05:40.289745 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-3bb7493a-6c11-4959-9011-369040e37ae5 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 38aca19c-e68f-4376-82c7-9ba0111c9e85] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:05:40.296231 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3bb7493a-6c11-4959-9011-369040e37ae5 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:40.296759 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3bb7493a-6c11-4959-9011-369040e37ae5 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:40.297546 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3bb7493a-6c11-4959-9011-369040e37ae5 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:40.298003 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3bb7493a-6c11-4959-9011-369040e37ae5 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:40.360346 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-3bb7493a-6c11-4959-9011-369040e37ae5 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c71b131fcdb495d829a615ebae65aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90cab30a20644dbabb505e1ada2dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:05:40.367541 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-3bb7493a-6c11-4959-9011-369040e37ae5 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/38aca19c-e68f-4376-82c7-9ba0111c9e85" status: 200 len: 1225 microversion: 2.1 time: 0.083838 Aug 07 05:05:40.368089 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 629/1217] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:05:40 2021] GET /compute/v2.1/servers/38aca19c-e68f-4376-82c7-9ba0111c9e85 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:05:40.424187 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-a66cefb7-55b6-4f69-b42c-146ff8e5e4b0 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:05:40.425486 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-a66cefb7-55b6-4f69-b42c-146ff8e5e4b0 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:05:40.431613 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a66cefb7-55b6-4f69-b42c-146ff8e5e4b0 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:40.432059 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a66cefb7-55b6-4f69-b42c-146ff8e5e4b0 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:40.432863 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a66cefb7-55b6-4f69-b42c-146ff8e5e4b0 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:40.433302 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a66cefb7-55b6-4f69-b42c-146ff8e5e4b0 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:40.537440 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-a66cefb7-55b6-4f69-b42c-146ff8e5e4b0 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 13731 microversion: 2.1 time: 0.117122 Aug 07 05:05:40.538084 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 589/1218] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:05:40 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 13731 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:05:41.384724 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-226dfd1a-2ecf-4d91-91fe-3b81b3d64daa tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:05:41.385372 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-226dfd1a-2ecf-4d91-91fe-3b81b3d64daa tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 38aca19c-e68f-4376-82c7-9ba0111c9e85] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:05:41.392307 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-226dfd1a-2ecf-4d91-91fe-3b81b3d64daa tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:41.392756 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-226dfd1a-2ecf-4d91-91fe-3b81b3d64daa tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:41.393555 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-226dfd1a-2ecf-4d91-91fe-3b81b3d64daa tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:41.393991 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-226dfd1a-2ecf-4d91-91fe-3b81b3d64daa tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:41.407876 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.wsgi [None req-226dfd1a-2ecf-4d91-91fe-3b81b3d64daa tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] HTTP exception thrown: Instance 38aca19c-e68f-4376-82c7-9ba0111c9e85 could not be found. Aug 07 05:05:41.408454 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-226dfd1a-2ecf-4d91-91fe-3b81b3d64daa tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Returning 404 to user: Instance 38aca19c-e68f-4376-82c7-9ba0111c9e85 could not be found. {{(pid=107486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 07 05:05:41.409302 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-226dfd1a-2ecf-4d91-91fe-3b81b3d64daa tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/38aca19c-e68f-4376-82c7-9ba0111c9e85" status: 404 len: 111 microversion: 2.1 time: 0.028343 Aug 07 05:05:41.409819 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 630/1219] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:05:41 2021] GET /compute/v2.1/servers/38aca19c-e68f-4376-82c7-9ba0111c9e85 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 05:05:41.548743 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-3538f757-6171-4463-9984-2eeea2a6d45d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:05:41.549834 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-3538f757-6171-4463-9984-2eeea2a6d45d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:05:41.562722 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3538f757-6171-4463-9984-2eeea2a6d45d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:41.563183 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3538f757-6171-4463-9984-2eeea2a6d45d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:41.564040 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3538f757-6171-4463-9984-2eeea2a6d45d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:41.564483 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3538f757-6171-4463-9984-2eeea2a6d45d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:41.670896 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-3538f757-6171-4463-9984-2eeea2a6d45d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 18498 microversion: 2.1 time: 0.125926 Aug 07 05:05:41.671515 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 590/1220] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:05:41 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 18498 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:05:41.858360 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-1884e0c6-5380-4ae2-a115-920a599c1648 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:05:41.858875 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-1884e0c6-5380-4ae2-a115-920a599c1648 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 9842981a-3233-41c1-a42b-442492d50f3a] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:05:41.864749 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1884e0c6-5380-4ae2-a115-920a599c1648 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:41.865226 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1884e0c6-5380-4ae2-a115-920a599c1648 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:41.865994 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1884e0c6-5380-4ae2-a115-920a599c1648 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:41.866427 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1884e0c6-5380-4ae2-a115-920a599c1648 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:41.879612 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.wsgi [None req-1884e0c6-5380-4ae2-a115-920a599c1648 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] HTTP exception thrown: Instance 9842981a-3233-41c1-a42b-442492d50f3a could not be found. Aug 07 05:05:41.880189 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-1884e0c6-5380-4ae2-a115-920a599c1648 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Returning 404 to user: Instance 9842981a-3233-41c1-a42b-442492d50f3a could not be found. {{(pid=107486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 07 05:05:41.881021 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-1884e0c6-5380-4ae2-a115-920a599c1648 tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "DELETE /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a" status: 404 len: 111 microversion: 2.1 time: 0.027458 Aug 07 05:05:41.881528 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 631/1221] 10.222.0.35 () {58 vars in 1239 bytes} [Sat Aug 7 05:05:41 2021] DELETE /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 05:05:41.889962 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-e7a29b30-a4a2-4647-9754-235988db50ea tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:05:41.890651 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-e7a29b30-a4a2-4647-9754-235988db50ea tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] [instance: 9842981a-3233-41c1-a42b-442492d50f3a] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:05:41.897030 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e7a29b30-a4a2-4647-9754-235988db50ea tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:41.897473 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e7a29b30-a4a2-4647-9754-235988db50ea tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:41.898231 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e7a29b30-a4a2-4647-9754-235988db50ea tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:41.898663 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e7a29b30-a4a2-4647-9754-235988db50ea tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:41.911930 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.wsgi [None req-e7a29b30-a4a2-4647-9754-235988db50ea tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] HTTP exception thrown: Instance 9842981a-3233-41c1-a42b-442492d50f3a could not be found. Aug 07 05:05:41.912532 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-e7a29b30-a4a2-4647-9754-235988db50ea tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Returning 404 to user: Instance 9842981a-3233-41c1-a42b-442492d50f3a could not be found. {{(pid=107485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 07 05:05:41.913362 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-e7a29b30-a4a2-4647-9754-235988db50ea tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "GET /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a" status: 404 len: 111 microversion: 2.1 time: 0.027509 Aug 07 05:05:41.913869 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 591/1222] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:05:41 2021] GET /compute/v2.1/servers/9842981a-3233-41c1-a42b-442492d50f3a => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 05:05:42.682084 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-80e98f7b-402b-4b09-980b-afb25fad3365 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:05:42.683214 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-80e98f7b-402b-4b09-980b-afb25fad3365 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:05:42.689589 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-80e98f7b-402b-4b09-980b-afb25fad3365 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:42.690035 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-80e98f7b-402b-4b09-980b-afb25fad3365 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:42.690798 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-80e98f7b-402b-4b09-980b-afb25fad3365 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:42.691229 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-80e98f7b-402b-4b09-980b-afb25fad3365 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:42.782240 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-80e98f7b-402b-4b09-980b-afb25fad3365 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 19342 microversion: 2.1 time: 0.103767 Aug 07 05:05:42.782851 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 632/1223] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:05:42 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 19342 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:05:43.194244 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-5edc4061-2502-4c48-b9e6-49b3d87a3eea tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] Calling method '.version_select at 0x7f75ebf5b790>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:05:43.222673 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-5edc4061-2502-4c48-b9e6-49b3d87a3eea tempest-TestVolumeBootPattern-136302521 tempest-TestVolumeBootPattern-136302521-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1125723205" status: 202 len: 0 microversion: 2.1 time: 0.032011 Aug 07 05:05:43.223248 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 592/1224] 10.222.0.35 () {58 vars in 1263 bytes} [Sat Aug 7 05:05:43 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1125723205 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:05:43.794255 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-4b63c473-07da-449f-8bec-feecc156b1dc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:05:43.796324 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-4b63c473-07da-449f-8bec-feecc156b1dc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:05:43.802807 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4b63c473-07da-449f-8bec-feecc156b1dc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:43.803252 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4b63c473-07da-449f-8bec-feecc156b1dc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:43.804025 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4b63c473-07da-449f-8bec-feecc156b1dc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:43.804458 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4b63c473-07da-449f-8bec-feecc156b1dc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:43.907609 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-4b63c473-07da-449f-8bec-feecc156b1dc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 21960 microversion: 2.1 time: 0.117220 Aug 07 05:05:43.908255 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 633/1225] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:05:43 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 21960 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:05:44.919614 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-a547c04a-d311-40aa-8f91-6f1e8bbcd6e4 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:05:44.920748 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-a547c04a-d311-40aa-8f91-6f1e8bbcd6e4 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:05:44.927472 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a547c04a-d311-40aa-8f91-6f1e8bbcd6e4 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:44.927989 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a547c04a-d311-40aa-8f91-6f1e8bbcd6e4 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:44.928993 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a547c04a-d311-40aa-8f91-6f1e8bbcd6e4 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:44.929369 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a547c04a-d311-40aa-8f91-6f1e8bbcd6e4 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:45.028987 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-a547c04a-d311-40aa-8f91-6f1e8bbcd6e4 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 23223 microversion: 2.1 time: 0.113247 Aug 07 05:05:45.030502 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 593/1226] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:05:44 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 23223 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:05:46.041572 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-93b78add-efca-4cee-87d3-a0c44536fab2 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:05:46.043170 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-93b78add-efca-4cee-87d3-a0c44536fab2 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:05:46.050553 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-93b78add-efca-4cee-87d3-a0c44536fab2 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:46.051084 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-93b78add-efca-4cee-87d3-a0c44536fab2 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:46.051770 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-93b78add-efca-4cee-87d3-a0c44536fab2 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:46.052211 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-93b78add-efca-4cee-87d3-a0c44536fab2 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:46.158243 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-93b78add-efca-4cee-87d3-a0c44536fab2 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 24904 microversion: 2.1 time: 0.120511 Aug 07 05:05:46.158897 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 634/1227] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:05:46 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 24904 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:05:47.179033 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-ef5742eb-d33f-4ed2-bd85-37bbe03cca2a tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:05:47.180027 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-ef5742eb-d33f-4ed2-bd85-37bbe03cca2a tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:05:47.186824 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ef5742eb-d33f-4ed2-bd85-37bbe03cca2a tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:47.187249 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ef5742eb-d33f-4ed2-bd85-37bbe03cca2a tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:47.188012 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ef5742eb-d33f-4ed2-bd85-37bbe03cca2a tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:47.188438 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ef5742eb-d33f-4ed2-bd85-37bbe03cca2a tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:47.293244 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-ef5742eb-d33f-4ed2-bd85-37bbe03cca2a tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 26422 microversion: 2.1 time: 0.121979 Aug 07 05:05:47.294881 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 594/1228] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:05:47 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 26422 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:05:48.306461 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-5d0b0870-2add-4409-ac6b-7dc5d12a4400 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:05:48.307473 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-5d0b0870-2add-4409-ac6b-7dc5d12a4400 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:05:48.315207 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5d0b0870-2add-4409-ac6b-7dc5d12a4400 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:48.315660 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5d0b0870-2add-4409-ac6b-7dc5d12a4400 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:48.316440 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5d0b0870-2add-4409-ac6b-7dc5d12a4400 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:48.316898 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5d0b0870-2add-4409-ac6b-7dc5d12a4400 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:48.416644 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-5d0b0870-2add-4409-ac6b-7dc5d12a4400 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 27473 microversion: 2.1 time: 0.114108 Aug 07 05:05:48.417327 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 635/1229] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:05:48 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 27473 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:05:49.429785 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-d2af6dd5-45cc-4bfa-8ac9-a87412e56911 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:05:49.431303 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-d2af6dd5-45cc-4bfa-8ac9-a87412e56911 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:05:49.439068 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d2af6dd5-45cc-4bfa-8ac9-a87412e56911 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:49.439940 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d2af6dd5-45cc-4bfa-8ac9-a87412e56911 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:49.441542 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d2af6dd5-45cc-4bfa-8ac9-a87412e56911 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:49.442195 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d2af6dd5-45cc-4bfa-8ac9-a87412e56911 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:49.562383 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-d2af6dd5-45cc-4bfa-8ac9-a87412e56911 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 27872 microversion: 2.1 time: 0.136865 Aug 07 05:05:49.566825 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 595/1230] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:05:49 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 27872 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:05:50.575410 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-bd317bcf-2cca-48d8-8b70-0b93976bad92 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:05:50.577333 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-bd317bcf-2cca-48d8-8b70-0b93976bad92 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:05:50.585766 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-bd317bcf-2cca-48d8-8b70-0b93976bad92 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:50.586209 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-bd317bcf-2cca-48d8-8b70-0b93976bad92 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:50.586998 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-bd317bcf-2cca-48d8-8b70-0b93976bad92 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:50.587432 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-bd317bcf-2cca-48d8-8b70-0b93976bad92 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:50.683639 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-bd317bcf-2cca-48d8-8b70-0b93976bad92 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 28251 microversion: 2.1 time: 0.112241 Aug 07 05:05:50.684303 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 636/1231] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:05:50 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 28251 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:05:51.695413 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-b7f4eb8f-cd2f-435d-9a11-93e77071540f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:05:51.696389 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-b7f4eb8f-cd2f-435d-9a11-93e77071540f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:05:51.703060 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b7f4eb8f-cd2f-435d-9a11-93e77071540f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:51.703509 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b7f4eb8f-cd2f-435d-9a11-93e77071540f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:51.704531 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b7f4eb8f-cd2f-435d-9a11-93e77071540f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:51.704988 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b7f4eb8f-cd2f-435d-9a11-93e77071540f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:51.791634 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-b7f4eb8f-cd2f-435d-9a11-93e77071540f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 28251 microversion: 2.1 time: 0.100193 Aug 07 05:05:51.792238 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 596/1232] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:05:51 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 28251 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:05:52.804216 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-645d62b9-348c-43cf-a848-963952b147c7 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:05:52.805249 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-645d62b9-348c-43cf-a848-963952b147c7 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:05:52.812502 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-645d62b9-348c-43cf-a848-963952b147c7 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:52.812994 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-645d62b9-348c-43cf-a848-963952b147c7 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:52.813765 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-645d62b9-348c-43cf-a848-963952b147c7 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:52.814199 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-645d62b9-348c-43cf-a848-963952b147c7 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:52.899957 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-645d62b9-348c-43cf-a848-963952b147c7 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 28251 microversion: 2.1 time: 0.099679 Aug 07 05:05:52.900493 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 637/1233] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:05:52 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 28251 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:05:53.911582 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-dd978a92-b1b5-4d65-a005-814265c11deb tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:05:53.912581 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-dd978a92-b1b5-4d65-a005-814265c11deb tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:05:53.919068 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-dd978a92-b1b5-4d65-a005-814265c11deb tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:53.919513 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-dd978a92-b1b5-4d65-a005-814265c11deb tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:53.920457 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-dd978a92-b1b5-4d65-a005-814265c11deb tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:53.920913 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-dd978a92-b1b5-4d65-a005-814265c11deb tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:54.000621 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-dd978a92-b1b5-4d65-a005-814265c11deb tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 28251 microversion: 2.1 time: 0.092945 Aug 07 05:05:54.001515 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 597/1234] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:05:53 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 28251 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:05:55.012761 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-79301eb4-c8d3-4ebf-8fd9-e3ffee792110 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:05:55.014353 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-79301eb4-c8d3-4ebf-8fd9-e3ffee792110 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:05:55.020779 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-79301eb4-c8d3-4ebf-8fd9-e3ffee792110 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:55.021250 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-79301eb4-c8d3-4ebf-8fd9-e3ffee792110 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:55.022005 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-79301eb4-c8d3-4ebf-8fd9-e3ffee792110 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:55.022442 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-79301eb4-c8d3-4ebf-8fd9-e3ffee792110 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:55.105376 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-79301eb4-c8d3-4ebf-8fd9-e3ffee792110 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 28251 microversion: 2.1 time: 0.096457 Aug 07 05:05:55.106006 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 638/1235] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:05:55 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 28251 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:05:56.116689 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-3922ddc8-070d-4315-9cf3-653dcc0c438c tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:05:56.117703 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-3922ddc8-070d-4315-9cf3-653dcc0c438c tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:05:56.124666 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3922ddc8-070d-4315-9cf3-653dcc0c438c tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:56.125131 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3922ddc8-070d-4315-9cf3-653dcc0c438c tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:56.125896 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3922ddc8-070d-4315-9cf3-653dcc0c438c tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:56.126324 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3922ddc8-070d-4315-9cf3-653dcc0c438c tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:56.210336 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-3922ddc8-070d-4315-9cf3-653dcc0c438c tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 28251 microversion: 2.1 time: 0.097481 Aug 07 05:05:56.211015 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 598/1236] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:05:56 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 28251 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:05:57.223002 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-a437559c-3e6c-4ca9-b660-4278c5689f71 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:05:57.223912 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-a437559c-3e6c-4ca9-b660-4278c5689f71 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:05:57.230446 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a437559c-3e6c-4ca9-b660-4278c5689f71 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:57.230888 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a437559c-3e6c-4ca9-b660-4278c5689f71 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:57.231640 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a437559c-3e6c-4ca9-b660-4278c5689f71 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:57.232585 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-a437559c-3e6c-4ca9-b660-4278c5689f71 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:57.313778 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-a437559c-3e6c-4ca9-b660-4278c5689f71 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 28251 microversion: 2.1 time: 0.094753 Aug 07 05:05:57.314649 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 639/1237] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:05:57 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 28251 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:05:58.327575 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-b227eb19-46fa-44e5-8bfe-9c6c210eed84 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:05:58.328559 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-b227eb19-46fa-44e5-8bfe-9c6c210eed84 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:05:58.335296 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b227eb19-46fa-44e5-8bfe-9c6c210eed84 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:58.335736 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b227eb19-46fa-44e5-8bfe-9c6c210eed84 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:58.336490 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b227eb19-46fa-44e5-8bfe-9c6c210eed84 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:58.336955 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b227eb19-46fa-44e5-8bfe-9c6c210eed84 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:58.431707 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-b227eb19-46fa-44e5-8bfe-9c6c210eed84 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 28251 microversion: 2.1 time: 0.109681 Aug 07 05:05:58.432331 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 599/1238] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:05:58 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 28251 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:05:59.445400 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-85ea0fdc-12a5-4d5f-864b-b7a7d8617387 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:05:59.446391 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-85ea0fdc-12a5-4d5f-864b-b7a7d8617387 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:05:59.452949 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-85ea0fdc-12a5-4d5f-864b-b7a7d8617387 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:59.453391 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-85ea0fdc-12a5-4d5f-864b-b7a7d8617387 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:59.454412 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-85ea0fdc-12a5-4d5f-864b-b7a7d8617387 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:05:59.454838 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-85ea0fdc-12a5-4d5f-864b-b7a7d8617387 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:05:59.543115 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-85ea0fdc-12a5-4d5f-864b-b7a7d8617387 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 28251 microversion: 2.1 time: 0.101598 Aug 07 05:05:59.543746 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 640/1239] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:05:59 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 28251 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:06:00.555771 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-0b4e6d2b-c3f6-4b6d-85db-339f88857c2b tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:06:00.556804 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-0b4e6d2b-c3f6-4b6d-85db-339f88857c2b tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:06:00.564349 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0b4e6d2b-c3f6-4b6d-85db-339f88857c2b tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:00.564815 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0b4e6d2b-c3f6-4b6d-85db-339f88857c2b tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:00.565583 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0b4e6d2b-c3f6-4b6d-85db-339f88857c2b tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:00.566013 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0b4e6d2b-c3f6-4b6d-85db-339f88857c2b tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:00.653589 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-0b4e6d2b-c3f6-4b6d-85db-339f88857c2b tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 28251 microversion: 2.1 time: 0.101747 Aug 07 05:06:00.654237 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 600/1240] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:06:00 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 28251 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:06:01.665699 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-83333a17-020a-4c29-a402-ac3a98efc23f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:06:01.666711 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-83333a17-020a-4c29-a402-ac3a98efc23f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:06:01.673281 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-83333a17-020a-4c29-a402-ac3a98efc23f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:01.673721 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-83333a17-020a-4c29-a402-ac3a98efc23f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:01.674479 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-83333a17-020a-4c29-a402-ac3a98efc23f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:01.674904 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-83333a17-020a-4c29-a402-ac3a98efc23f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:01.757750 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-83333a17-020a-4c29-a402-ac3a98efc23f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 28251 microversion: 2.1 time: 0.095961 Aug 07 05:06:01.758420 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 641/1241] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:06:01 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 28251 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:06:02.770262 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-3ed8ee6c-4a27-4f8e-ac5c-efaf60a1e36e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:06:02.771307 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-3ed8ee6c-4a27-4f8e-ac5c-efaf60a1e36e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:06:02.777773 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3ed8ee6c-4a27-4f8e-ac5c-efaf60a1e36e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:02.778218 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3ed8ee6c-4a27-4f8e-ac5c-efaf60a1e36e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:02.780061 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3ed8ee6c-4a27-4f8e-ac5c-efaf60a1e36e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:02.780504 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3ed8ee6c-4a27-4f8e-ac5c-efaf60a1e36e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:02.881072 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-3ed8ee6c-4a27-4f8e-ac5c-efaf60a1e36e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 28542 microversion: 2.1 time: 0.115107 Aug 07 05:06:02.881634 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 601/1242] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:06:02 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 28542 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 07 05:06:03.892568 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-098d5468-8116-460f-b1ae-cc7b0b81c7c6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:06:03.893517 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-098d5468-8116-460f-b1ae-cc7b0b81c7c6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:06:03.900019 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-098d5468-8116-460f-b1ae-cc7b0b81c7c6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:03.900470 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-098d5468-8116-460f-b1ae-cc7b0b81c7c6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:03.901275 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-098d5468-8116-460f-b1ae-cc7b0b81c7c6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:03.901715 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-098d5468-8116-460f-b1ae-cc7b0b81c7c6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:03.981764 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-098d5468-8116-460f-b1ae-cc7b0b81c7c6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 28542 microversion: 2.1 time: 0.093740 Aug 07 05:06:03.982381 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 642/1243] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:06:03 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 28542 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:06:04.993702 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-d1023696-037c-41b6-9573-8422cab6e42c tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:06:04.994694 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-d1023696-037c-41b6-9573-8422cab6e42c tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:06:05.001740 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d1023696-037c-41b6-9573-8422cab6e42c tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:05.002184 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d1023696-037c-41b6-9573-8422cab6e42c tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:05.002947 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d1023696-037c-41b6-9573-8422cab6e42c tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:05.003378 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d1023696-037c-41b6-9573-8422cab6e42c tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:05.090492 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-d1023696-037c-41b6-9573-8422cab6e42c tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 28710 microversion: 2.1 time: 0.100686 Aug 07 05:06:05.092041 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 602/1244] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:06:04 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 28710 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:06:06.102992 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-71984d53-bff6-47f6-be71-a751ac742379 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:06:06.103980 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-71984d53-bff6-47f6-be71-a751ac742379 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:06:06.111059 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-71984d53-bff6-47f6-be71-a751ac742379 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:06.111503 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-71984d53-bff6-47f6-be71-a751ac742379 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:06.112261 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-71984d53-bff6-47f6-be71-a751ac742379 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:06.112689 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-71984d53-bff6-47f6-be71-a751ac742379 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:06.194116 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-71984d53-bff6-47f6-be71-a751ac742379 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 28710 microversion: 2.1 time: 0.094997 Aug 07 05:06:06.194731 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 643/1245] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:06:06 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 28710 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:06:07.206453 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-1445d49c-6d0b-4fbe-9806-fef529165dd4 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:06:07.207372 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-1445d49c-6d0b-4fbe-9806-fef529165dd4 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:06:07.214096 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1445d49c-6d0b-4fbe-9806-fef529165dd4 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:07.214532 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1445d49c-6d0b-4fbe-9806-fef529165dd4 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:07.215287 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1445d49c-6d0b-4fbe-9806-fef529165dd4 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:07.215712 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1445d49c-6d0b-4fbe-9806-fef529165dd4 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:07.298739 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-1445d49c-6d0b-4fbe-9806-fef529165dd4 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 28710 microversion: 2.1 time: 0.096490 Aug 07 05:06:07.299349 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 603/1246] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:06:07 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 28710 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:06:08.310786 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-41f6d45a-01bf-44c2-9115-de7a9f513b81 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:06:08.311769 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-41f6d45a-01bf-44c2-9115-de7a9f513b81 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:06:08.318229 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-41f6d45a-01bf-44c2-9115-de7a9f513b81 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:08.318670 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-41f6d45a-01bf-44c2-9115-de7a9f513b81 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:08.319428 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-41f6d45a-01bf-44c2-9115-de7a9f513b81 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:08.319856 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-41f6d45a-01bf-44c2-9115-de7a9f513b81 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:08.405251 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-41f6d45a-01bf-44c2-9115-de7a9f513b81 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 28710 microversion: 2.1 time: 0.098330 Aug 07 05:06:08.405889 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 644/1247] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:06:08 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 28710 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:06:09.417439 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-26b982a5-f364-4ba4-87ef-4d6ab2f08c1c tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:06:09.418433 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-26b982a5-f364-4ba4-87ef-4d6ab2f08c1c tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:06:09.429385 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-26b982a5-f364-4ba4-87ef-4d6ab2f08c1c tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:09.430215 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-26b982a5-f364-4ba4-87ef-4d6ab2f08c1c tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:09.431674 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-26b982a5-f364-4ba4-87ef-4d6ab2f08c1c tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:09.432484 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-26b982a5-f364-4ba4-87ef-4d6ab2f08c1c tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:09.518301 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-26b982a5-f364-4ba4-87ef-4d6ab2f08c1c tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 28710 microversion: 2.1 time: 0.104752 Aug 07 05:06:09.519163 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 604/1248] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:06:09 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 28710 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:06:10.530446 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-83fe22bb-91ca-44e6-9dd7-050f64b305c9 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:06:10.531437 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-83fe22bb-91ca-44e6-9dd7-050f64b305c9 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:06:10.538082 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-83fe22bb-91ca-44e6-9dd7-050f64b305c9 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:10.538531 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-83fe22bb-91ca-44e6-9dd7-050f64b305c9 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:10.539300 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-83fe22bb-91ca-44e6-9dd7-050f64b305c9 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:10.539735 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-83fe22bb-91ca-44e6-9dd7-050f64b305c9 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:10.627825 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-83fe22bb-91ca-44e6-9dd7-050f64b305c9 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 28710 microversion: 2.1 time: 0.101385 Aug 07 05:06:10.628751 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 645/1249] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:06:10 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 28710 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:06:11.641009 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-064c5c5a-f21a-4be4-99d2-6bc6ef5abc0d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:06:11.642006 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-064c5c5a-f21a-4be4-99d2-6bc6ef5abc0d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:06:11.648468 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-064c5c5a-f21a-4be4-99d2-6bc6ef5abc0d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:11.648959 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-064c5c5a-f21a-4be4-99d2-6bc6ef5abc0d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:11.649724 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-064c5c5a-f21a-4be4-99d2-6bc6ef5abc0d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:11.650156 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-064c5c5a-f21a-4be4-99d2-6bc6ef5abc0d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:11.729626 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-064c5c5a-f21a-4be4-99d2-6bc6ef5abc0d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 28710 microversion: 2.1 time: 0.093688 Aug 07 05:06:11.730266 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 605/1250] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:06:11 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 28710 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:06:12.742023 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-b4afbeef-2462-498f-9dd3-79656f36f36d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:06:12.743004 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-b4afbeef-2462-498f-9dd3-79656f36f36d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:06:12.750278 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b4afbeef-2462-498f-9dd3-79656f36f36d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:12.750727 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b4afbeef-2462-498f-9dd3-79656f36f36d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:12.751492 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b4afbeef-2462-498f-9dd3-79656f36f36d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:12.751919 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b4afbeef-2462-498f-9dd3-79656f36f36d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:12.824946 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 05:06:12.825125 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: Sat Aug 7 05:06:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action (ip 10.222.0.35) !!! Aug 07 05:06:12.841191 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-b4afbeef-2462-498f-9dd3-79656f36f36d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 28710 microversion: 2.1 time: 0.103109 Aug 07 05:06:12.842930 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 646/1251] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:06:12 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 28710 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:06:13.853495 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-1543a8c7-f0db-4bc3-b043-c8b0308757d1 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:06:13.854474 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-1543a8c7-f0db-4bc3-b043-c8b0308757d1 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:06:13.861521 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1543a8c7-f0db-4bc3-b043-c8b0308757d1 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:13.861962 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1543a8c7-f0db-4bc3-b043-c8b0308757d1 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:13.862724 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1543a8c7-f0db-4bc3-b043-c8b0308757d1 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:13.863153 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1543a8c7-f0db-4bc3-b043-c8b0308757d1 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:13.949730 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-1543a8c7-f0db-4bc3-b043-c8b0308757d1 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 28710 microversion: 2.1 time: 0.100043 Aug 07 05:06:13.950297 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 606/1252] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:06:13 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 28710 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:06:14.961908 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-0bc2f41d-4da4-4f03-92f1-6ce147e4ef7e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:06:14.962897 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-0bc2f41d-4da4-4f03-92f1-6ce147e4ef7e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:06:14.969480 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0bc2f41d-4da4-4f03-92f1-6ce147e4ef7e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:14.969924 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0bc2f41d-4da4-4f03-92f1-6ce147e4ef7e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:14.970686 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0bc2f41d-4da4-4f03-92f1-6ce147e4ef7e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:14.971116 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0bc2f41d-4da4-4f03-92f1-6ce147e4ef7e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:15.057647 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-0bc2f41d-4da4-4f03-92f1-6ce147e4ef7e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 28710 microversion: 2.1 time: 0.099576 Aug 07 05:06:15.058257 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 647/1253] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:06:14 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 28710 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:06:16.070232 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-d951449b-6bb1-4819-8c1c-b82be3ca6e00 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:06:16.071132 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-d951449b-6bb1-4819-8c1c-b82be3ca6e00 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:06:16.078516 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d951449b-6bb1-4819-8c1c-b82be3ca6e00 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:16.078963 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d951449b-6bb1-4819-8c1c-b82be3ca6e00 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:16.079984 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d951449b-6bb1-4819-8c1c-b82be3ca6e00 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:16.080413 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d951449b-6bb1-4819-8c1c-b82be3ca6e00 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:16.162513 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-d951449b-6bb1-4819-8c1c-b82be3ca6e00 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 28710 microversion: 2.1 time: 0.096205 Aug 07 05:06:16.163138 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 607/1254] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:06:16 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 28710 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:06:17.175239 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-921891d4-6121-4c04-91f1-7c1210bcd896 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:06:17.176224 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-921891d4-6121-4c04-91f1-7c1210bcd896 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:06:17.182775 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-921891d4-6121-4c04-91f1-7c1210bcd896 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:17.183221 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-921891d4-6121-4c04-91f1-7c1210bcd896 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:17.183986 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-921891d4-6121-4c04-91f1-7c1210bcd896 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:17.184416 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-921891d4-6121-4c04-91f1-7c1210bcd896 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:17.265603 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-921891d4-6121-4c04-91f1-7c1210bcd896 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 28710 microversion: 2.1 time: 0.094326 Aug 07 05:06:17.266142 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 648/1255] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:06:17 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 28710 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:06:18.277528 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-50c63074-8e48-4093-9337-c59dc979e135 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:06:18.278525 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-50c63074-8e48-4093-9337-c59dc979e135 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:06:18.285664 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-50c63074-8e48-4093-9337-c59dc979e135 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:18.286115 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-50c63074-8e48-4093-9337-c59dc979e135 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:18.286881 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-50c63074-8e48-4093-9337-c59dc979e135 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:18.287315 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-50c63074-8e48-4093-9337-c59dc979e135 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:18.376069 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-50c63074-8e48-4093-9337-c59dc979e135 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 28710 microversion: 2.1 time: 0.102453 Aug 07 05:06:18.376684 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 608/1256] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:06:18 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 28710 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:06:19.387884 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-46d21cf2-7acb-4c87-8af1-a441754ff238 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:06:19.389611 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-46d21cf2-7acb-4c87-8af1-a441754ff238 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:06:19.396028 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-46d21cf2-7acb-4c87-8af1-a441754ff238 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:19.396467 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-46d21cf2-7acb-4c87-8af1-a441754ff238 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:19.397254 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-46d21cf2-7acb-4c87-8af1-a441754ff238 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:19.397680 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-46d21cf2-7acb-4c87-8af1-a441754ff238 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:19.481076 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-46d21cf2-7acb-4c87-8af1-a441754ff238 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 28710 microversion: 2.1 time: 0.096969 Aug 07 05:06:19.481705 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 649/1257] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:06:19 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 28710 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:06:20.493078 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-23f7bcf6-59b3-4562-a8a8-37436aad2f69 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:06:20.494095 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-23f7bcf6-59b3-4562-a8a8-37436aad2f69 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:06:20.500812 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-23f7bcf6-59b3-4562-a8a8-37436aad2f69 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:20.501271 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-23f7bcf6-59b3-4562-a8a8-37436aad2f69 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:20.502028 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-23f7bcf6-59b3-4562-a8a8-37436aad2f69 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:20.502456 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-23f7bcf6-59b3-4562-a8a8-37436aad2f69 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:20.590370 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-23f7bcf6-59b3-4562-a8a8-37436aad2f69 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 28710 microversion: 2.1 time: 0.101210 Aug 07 05:06:20.591898 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 609/1258] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:06:20 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 28710 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:06:21.602547 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-82165668-a7dd-4b31-a9ca-43870219c98d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:06:21.603544 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-82165668-a7dd-4b31-a9ca-43870219c98d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:06:21.610924 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-82165668-a7dd-4b31-a9ca-43870219c98d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:21.611319 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-82165668-a7dd-4b31-a9ca-43870219c98d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:21.612114 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-82165668-a7dd-4b31-a9ca-43870219c98d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:21.612560 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-82165668-a7dd-4b31-a9ca-43870219c98d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:21.702639 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-82165668-a7dd-4b31-a9ca-43870219c98d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 28710 microversion: 2.1 time: 0.103987 Aug 07 05:06:21.703275 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 650/1259] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:06:21 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 28710 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:06:22.714818 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-d7a8f5a0-b663-406f-b180-92ce187b67d5 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:06:22.715809 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-d7a8f5a0-b663-406f-b180-92ce187b67d5 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:06:22.725089 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d7a8f5a0-b663-406f-b180-92ce187b67d5 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:22.725536 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d7a8f5a0-b663-406f-b180-92ce187b67d5 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:22.726315 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d7a8f5a0-b663-406f-b180-92ce187b67d5 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:22.726756 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d7a8f5a0-b663-406f-b180-92ce187b67d5 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:22.807766 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-d7a8f5a0-b663-406f-b180-92ce187b67d5 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 28710 microversion: 2.1 time: 0.096862 Aug 07 05:06:22.808379 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 610/1260] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:06:22 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 28710 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:06:23.819677 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-440b3480-6b30-4579-b215-679c223c813d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:06:23.820668 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-440b3480-6b30-4579-b215-679c223c813d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:06:23.827802 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-440b3480-6b30-4579-b215-679c223c813d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:23.828244 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-440b3480-6b30-4579-b215-679c223c813d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:23.829082 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-440b3480-6b30-4579-b215-679c223c813d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:23.829776 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-440b3480-6b30-4579-b215-679c223c813d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:23.911245 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-440b3480-6b30-4579-b215-679c223c813d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 28710 microversion: 2.1 time: 0.095461 Aug 07 05:06:23.912318 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 651/1261] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:06:23 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 28710 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:06:24.923379 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-d63ebd90-c55d-419f-af45-2026b5b8f241 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:06:24.924270 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-d63ebd90-c55d-419f-af45-2026b5b8f241 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:06:24.930693 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d63ebd90-c55d-419f-af45-2026b5b8f241 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:24.931128 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d63ebd90-c55d-419f-af45-2026b5b8f241 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:24.931897 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d63ebd90-c55d-419f-af45-2026b5b8f241 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:24.932328 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d63ebd90-c55d-419f-af45-2026b5b8f241 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:25.017790 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-d63ebd90-c55d-419f-af45-2026b5b8f241 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 28710 microversion: 2.1 time: 0.098440 Aug 07 05:06:25.018403 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 611/1262] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:06:24 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 28710 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:06:26.030220 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-1d9daaf1-6085-46f4-aee5-ed63e01dffe0 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:06:26.031124 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-1d9daaf1-6085-46f4-aee5-ed63e01dffe0 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:06:26.037609 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1d9daaf1-6085-46f4-aee5-ed63e01dffe0 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:26.038053 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1d9daaf1-6085-46f4-aee5-ed63e01dffe0 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:26.038818 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1d9daaf1-6085-46f4-aee5-ed63e01dffe0 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:26.039257 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-1d9daaf1-6085-46f4-aee5-ed63e01dffe0 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:26.120388 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-1d9daaf1-6085-46f4-aee5-ed63e01dffe0 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 28710 microversion: 2.1 time: 0.094642 Aug 07 05:06:26.121073 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 652/1263] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:06:26 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 28710 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:06:27.131984 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-56c3a2f6-fbe4-4c4d-b81a-2bf805c07f9e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:06:27.133065 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-56c3a2f6-fbe4-4c4d-b81a-2bf805c07f9e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:06:27.139681 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-56c3a2f6-fbe4-4c4d-b81a-2bf805c07f9e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:27.140122 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-56c3a2f6-fbe4-4c4d-b81a-2bf805c07f9e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:27.140926 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-56c3a2f6-fbe4-4c4d-b81a-2bf805c07f9e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:27.141356 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-56c3a2f6-fbe4-4c4d-b81a-2bf805c07f9e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:27.235538 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-56c3a2f6-fbe4-4c4d-b81a-2bf805c07f9e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 28710 microversion: 2.1 time: 0.107374 Aug 07 05:06:27.236084 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 612/1264] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:06:27 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 28710 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:06:28.247228 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-03782b11-95ba-4fd3-af7c-ec2edf7c4dff tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:06:28.248925 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-03782b11-95ba-4fd3-af7c-ec2edf7c4dff tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:06:28.255413 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-03782b11-95ba-4fd3-af7c-ec2edf7c4dff tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:28.255855 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-03782b11-95ba-4fd3-af7c-ec2edf7c4dff tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:28.256605 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-03782b11-95ba-4fd3-af7c-ec2edf7c4dff tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:28.257059 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-03782b11-95ba-4fd3-af7c-ec2edf7c4dff tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:28.340810 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-03782b11-95ba-4fd3-af7c-ec2edf7c4dff tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 28710 microversion: 2.1 time: 0.097482 Aug 07 05:06:28.341567 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 653/1265] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:06:28 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 28710 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:06:29.353283 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-5f5c5d1f-25d4-4434-acb4-fcdc57e9bb33 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:06:29.354270 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-5f5c5d1f-25d4-4434-acb4-fcdc57e9bb33 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:06:29.361331 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5f5c5d1f-25d4-4434-acb4-fcdc57e9bb33 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:29.361770 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5f5c5d1f-25d4-4434-acb4-fcdc57e9bb33 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:29.362525 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5f5c5d1f-25d4-4434-acb4-fcdc57e9bb33 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:29.362947 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5f5c5d1f-25d4-4434-acb4-fcdc57e9bb33 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:29.446320 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-5f5c5d1f-25d4-4434-acb4-fcdc57e9bb33 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 28710 microversion: 2.1 time: 0.097047 Aug 07 05:06:29.447186 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 613/1266] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:06:29 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 28710 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:06:30.458554 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-94290c85-3cc1-4d03-b390-d4da59e69f0d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:06:30.459542 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-94290c85-3cc1-4d03-b390-d4da59e69f0d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:06:30.466097 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-94290c85-3cc1-4d03-b390-d4da59e69f0d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:30.467258 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-94290c85-3cc1-4d03-b390-d4da59e69f0d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:30.468290 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-94290c85-3cc1-4d03-b390-d4da59e69f0d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:30.468736 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-94290c85-3cc1-4d03-b390-d4da59e69f0d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:30.549069 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-94290c85-3cc1-4d03-b390-d4da59e69f0d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 28710 microversion: 2.1 time: 0.094650 Aug 07 05:06:30.549920 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 654/1267] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:06:30 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 28710 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:06:31.561686 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-970f150a-293d-4133-972f-a4513f97d16b tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:06:31.562667 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-970f150a-293d-4133-972f-a4513f97d16b tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:06:31.569108 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-970f150a-293d-4133-972f-a4513f97d16b tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:31.569549 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-970f150a-293d-4133-972f-a4513f97d16b tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:31.570303 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-970f150a-293d-4133-972f-a4513f97d16b tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:31.570730 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-970f150a-293d-4133-972f-a4513f97d16b tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:31.658485 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-970f150a-293d-4133-972f-a4513f97d16b tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 28710 microversion: 2.1 time: 0.101317 Aug 07 05:06:31.659123 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 614/1268] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:06:31 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 28710 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:06:32.670994 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-0a11a604-ae85-448d-87be-43ffba52ccec tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:06:32.671981 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-0a11a604-ae85-448d-87be-43ffba52ccec tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:06:32.678501 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0a11a604-ae85-448d-87be-43ffba52ccec tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:32.678950 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0a11a604-ae85-448d-87be-43ffba52ccec tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:32.679719 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0a11a604-ae85-448d-87be-43ffba52ccec tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:32.680154 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0a11a604-ae85-448d-87be-43ffba52ccec tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:32.777172 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-0a11a604-ae85-448d-87be-43ffba52ccec tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 30106 microversion: 2.1 time: 0.110691 Aug 07 05:06:32.777822 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 655/1269] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:06:32 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 30106 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:06:33.790163 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-3a381d91-b701-4ea5-b0ef-9dc5577a0e9b tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:06:33.791144 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-3a381d91-b701-4ea5-b0ef-9dc5577a0e9b tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:06:33.797562 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3a381d91-b701-4ea5-b0ef-9dc5577a0e9b tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:33.798003 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3a381d91-b701-4ea5-b0ef-9dc5577a0e9b tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:33.798755 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3a381d91-b701-4ea5-b0ef-9dc5577a0e9b tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:33.799180 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3a381d91-b701-4ea5-b0ef-9dc5577a0e9b tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:33.887750 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-3a381d91-b701-4ea5-b0ef-9dc5577a0e9b tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 32200 microversion: 2.1 time: 0.101515 Aug 07 05:06:33.888338 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 615/1270] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:06:33 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 32200 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:06:34.899942 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-112feb32-7ff8-4090-b42a-0cbfec3211d4 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:06:34.900858 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-112feb32-7ff8-4090-b42a-0cbfec3211d4 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:06:34.907601 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-112feb32-7ff8-4090-b42a-0cbfec3211d4 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:34.908045 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-112feb32-7ff8-4090-b42a-0cbfec3211d4 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:34.908812 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-112feb32-7ff8-4090-b42a-0cbfec3211d4 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:34.909246 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-112feb32-7ff8-4090-b42a-0cbfec3211d4 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:35.001698 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-112feb32-7ff8-4090-b42a-0cbfec3211d4 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 33536 microversion: 2.1 time: 0.105786 Aug 07 05:06:35.002316 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 656/1271] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:06:34 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 33536 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:06:36.014611 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-a0057579-1efc-49ff-85cc-f345ba33e569 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:06:36.015583 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-a0057579-1efc-49ff-85cc-f345ba33e569 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:06:36.022097 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a0057579-1efc-49ff-85cc-f345ba33e569 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:36.022547 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a0057579-1efc-49ff-85cc-f345ba33e569 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:36.023314 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a0057579-1efc-49ff-85cc-f345ba33e569 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:36.023748 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a0057579-1efc-49ff-85cc-f345ba33e569 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:36.122877 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-a0057579-1efc-49ff-85cc-f345ba33e569 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 34653 microversion: 2.1 time: 0.112892 Aug 07 05:06:36.124172 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 616/1272] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:06:36 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 34653 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:06:37.135896 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-8f3b5627-27a9-4ddb-9dc3-1a4919c9d603 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:06:37.136915 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-8f3b5627-27a9-4ddb-9dc3-1a4919c9d603 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:06:37.143509 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8f3b5627-27a9-4ddb-9dc3-1a4919c9d603 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:37.143956 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8f3b5627-27a9-4ddb-9dc3-1a4919c9d603 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:37.144725 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8f3b5627-27a9-4ddb-9dc3-1a4919c9d603 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:37.145212 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8f3b5627-27a9-4ddb-9dc3-1a4919c9d603 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:37.232450 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-8f3b5627-27a9-4ddb-9dc3-1a4919c9d603 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 35784 microversion: 2.1 time: 0.100431 Aug 07 05:06:37.233748 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 657/1273] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:06:37 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 35784 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:06:38.244884 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-7cb81ee6-917a-4b04-b3b6-7734ed99b547 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:06:38.245892 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-7cb81ee6-917a-4b04-b3b6-7734ed99b547 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:06:38.253062 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7cb81ee6-917a-4b04-b3b6-7734ed99b547 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:38.253514 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7cb81ee6-917a-4b04-b3b6-7734ed99b547 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:38.254282 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7cb81ee6-917a-4b04-b3b6-7734ed99b547 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:38.254719 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7cb81ee6-917a-4b04-b3b6-7734ed99b547 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:38.343008 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-7cb81ee6-917a-4b04-b3b6-7734ed99b547 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 37488 microversion: 2.1 time: 0.101833 Aug 07 05:06:38.343660 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 617/1274] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:06:38 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 37488 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:06:39.355819 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-f749d5b7-6cda-43f2-81d4-d2c93b62fe25 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:06:39.356939 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-f749d5b7-6cda-43f2-81d4-d2c93b62fe25 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:06:39.364130 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f749d5b7-6cda-43f2-81d4-d2c93b62fe25 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:39.364580 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f749d5b7-6cda-43f2-81d4-d2c93b62fe25 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:39.365387 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f749d5b7-6cda-43f2-81d4-d2c93b62fe25 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:39.365824 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f749d5b7-6cda-43f2-81d4-d2c93b62fe25 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:39.452778 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-f749d5b7-6cda-43f2-81d4-d2c93b62fe25 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 38245 microversion: 2.1 time: 0.100895 Aug 07 05:06:39.453432 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 658/1275] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:06:39 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 38245 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:06:40.465414 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-bca93e44-b98a-4a7d-a947-59d477cd9173 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:06:40.466541 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-bca93e44-b98a-4a7d-a947-59d477cd9173 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:06:40.473830 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-bca93e44-b98a-4a7d-a947-59d477cd9173 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:40.474282 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-bca93e44-b98a-4a7d-a947-59d477cd9173 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:40.475061 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-bca93e44-b98a-4a7d-a947-59d477cd9173 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:40.475498 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-bca93e44-b98a-4a7d-a947-59d477cd9173 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:40.569995 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-bca93e44-b98a-4a7d-a947-59d477cd9173 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 38245 microversion: 2.1 time: 0.108544 Aug 07 05:06:40.570619 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 618/1276] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:06:40 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 38245 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:06:41.582183 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-b40595bb-8dfa-4248-a95f-3427b34439cf tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:06:41.583179 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-b40595bb-8dfa-4248-a95f-3427b34439cf tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:06:41.590341 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b40595bb-8dfa-4248-a95f-3427b34439cf tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:41.590796 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b40595bb-8dfa-4248-a95f-3427b34439cf tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:41.591554 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b40595bb-8dfa-4248-a95f-3427b34439cf tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:41.592261 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b40595bb-8dfa-4248-a95f-3427b34439cf tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:41.678880 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-b40595bb-8dfa-4248-a95f-3427b34439cf tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 38245 microversion: 2.1 time: 0.100834 Aug 07 05:06:41.679507 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 659/1277] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:06:41 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 38245 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:06:42.692109 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-5513e65b-1e49-4000-9130-a3f3aae4bf1f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:06:42.693125 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-5513e65b-1e49-4000-9130-a3f3aae4bf1f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:06:42.699549 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5513e65b-1e49-4000-9130-a3f3aae4bf1f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:42.699998 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5513e65b-1e49-4000-9130-a3f3aae4bf1f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:42.700769 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5513e65b-1e49-4000-9130-a3f3aae4bf1f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:42.701206 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5513e65b-1e49-4000-9130-a3f3aae4bf1f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:42.788418 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-5513e65b-1e49-4000-9130-a3f3aae4bf1f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 38245 microversion: 2.1 time: 0.100221 Aug 07 05:06:42.789061 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 619/1278] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:06:42 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 38245 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:06:43.800229 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-cbba0fa3-b05f-4073-bc63-71c3e8e8f2b0 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:06:43.801269 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-cbba0fa3-b05f-4073-bc63-71c3e8e8f2b0 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:06:43.808088 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-cbba0fa3-b05f-4073-bc63-71c3e8e8f2b0 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:43.808540 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-cbba0fa3-b05f-4073-bc63-71c3e8e8f2b0 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:43.809429 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-cbba0fa3-b05f-4073-bc63-71c3e8e8f2b0 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:43.809864 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-cbba0fa3-b05f-4073-bc63-71c3e8e8f2b0 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:43.907227 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-cbba0fa3-b05f-4073-bc63-71c3e8e8f2b0 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 200 len: 38376 microversion: 2.1 time: 0.110824 Aug 07 05:06:43.909577 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 660/1279] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:06:43 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 38376 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:06:43.918090 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-6ba71a15-d388-4cde-bfd3-f273c9937e6b tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:06:43.918742 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-6ba71a15-d388-4cde-bfd3-f273c9937e6b tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:06:43.925908 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6ba71a15-d388-4cde-bfd3-f273c9937e6b tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:43.926354 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6ba71a15-d388-4cde-bfd3-f273c9937e6b tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:43.927120 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6ba71a15-d388-4cde-bfd3-f273c9937e6b tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:43.927556 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6ba71a15-d388-4cde-bfd3-f273c9937e6b tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:43.950994 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-6ba71a15-d388-4cde-bfd3-f273c9937e6b tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/ips" status: 200 len: 145 microversion: 2.1 time: 0.037070 Aug 07 05:06:43.951548 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 620/1280] 10.222.0.35 () {58 vars in 1248 bytes} [Sat Aug 7 05:06:43 2021] GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/ips => generated 145 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 05:06:46.257604 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-7113e3fc-4b8f-4841-a3cf-0217b63fd5d2 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f55121ea-8c9e-47b0-91e0-6ba34f25fced"}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:06:46.258745 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-7113e3fc-4b8f-4841-a3cf-0217b63fd5d2 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:06:46.265455 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-7113e3fc-4b8f-4841-a3cf-0217b63fd5d2 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:46.265905 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-7113e3fc-4b8f-4841-a3cf-0217b63fd5d2 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:46.266674 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-7113e3fc-4b8f-4841-a3cf-0217b63fd5d2 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:46.267113 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-7113e3fc-4b8f-4841-a3cf-0217b63fd5d2 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:46.515713 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-7113e3fc-4b8f-4841-a3cf-0217b63fd5d2 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.262021 Aug 07 05:06:46.516345 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 661/1281] 10.222.0.35 () {60 vars in 1323 bytes} [Sat Aug 7 05:06:46 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/os-volume_attachments => generated 194 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 05:06:54.025090 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-a28334c2-26ca-4f82-8e46-df8158400ad7 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:06:54.032135 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a28334c2-26ca-4f82-8e46-df8158400ad7 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:54.032577 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a28334c2-26ca-4f82-8e46-df8158400ad7 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:54.092697 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-a28334c2-26ca-4f82-8e46-df8158400ad7 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Going to try to stop instance {{(pid=107485) force_stop /opt/stack/nova/nova/compute/api.py:2580}} Aug 07 05:06:54.133696 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-a28334c2-26ca-4f82-8e46-df8158400ad7 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 202 len: 0 microversion: 2.1 time: 0.112160 Aug 07 05:06:54.134283 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 621/1282] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:06:54 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:06:54.143749 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-5b163cdd-7aad-4e69-a6ce-3194a48dc1ee tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:06:54.144442 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-5b163cdd-7aad-4e69-a6ce-3194a48dc1ee tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:06:54.150978 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5b163cdd-7aad-4e69-a6ce-3194a48dc1ee tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:54.151559 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5b163cdd-7aad-4e69-a6ce-3194a48dc1ee tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:54.152399 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5b163cdd-7aad-4e69-a6ce-3194a48dc1ee tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:54.152860 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5b163cdd-7aad-4e69-a6ce-3194a48dc1ee tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:54.280447 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-5b163cdd-7aad-4e69-a6ce-3194a48dc1ee tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5472ec0a0ae74e9bbf00e2bcf5db21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8063f2f6d64b79928f170fd6d99da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:06:54.289396 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-5b163cdd-7aad-4e69-a6ce-3194a48dc1ee tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186" status: 200 len: 1723 microversion: 2.1 time: 0.150603 Aug 07 05:06:54.289975 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 662/1283] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:06:54 2021] GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 05:06:55.306993 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-35abf141-9eb2-4c7e-bd93-fc8c966b707a tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:06:55.307612 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-35abf141-9eb2-4c7e-bd93-fc8c966b707a tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:06:55.314413 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-35abf141-9eb2-4c7e-bd93-fc8c966b707a tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:55.314861 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-35abf141-9eb2-4c7e-bd93-fc8c966b707a tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:55.315668 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-35abf141-9eb2-4c7e-bd93-fc8c966b707a tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:55.316106 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-35abf141-9eb2-4c7e-bd93-fc8c966b707a tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:55.436854 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-35abf141-9eb2-4c7e-bd93-fc8c966b707a tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5472ec0a0ae74e9bbf00e2bcf5db21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8063f2f6d64b79928f170fd6d99da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:06:55.444546 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-35abf141-9eb2-4c7e-bd93-fc8c966b707a tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186" status: 200 len: 1723 microversion: 2.1 time: 0.141711 Aug 07 05:06:55.445149 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 622/1284] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:06:55 2021] GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186 => generated 1723 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:06:56.461751 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-6e82b8d6-25d5-49b0-a005-b56f6eba32c3 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:06:56.462362 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-6e82b8d6-25d5-49b0-a005-b56f6eba32c3 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:06:56.469646 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6e82b8d6-25d5-49b0-a005-b56f6eba32c3 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:56.470110 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6e82b8d6-25d5-49b0-a005-b56f6eba32c3 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:56.470980 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6e82b8d6-25d5-49b0-a005-b56f6eba32c3 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:56.471441 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6e82b8d6-25d5-49b0-a005-b56f6eba32c3 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:56.589117 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-6e82b8d6-25d5-49b0-a005-b56f6eba32c3 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5472ec0a0ae74e9bbf00e2bcf5db21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8063f2f6d64b79928f170fd6d99da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:06:56.597729 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-6e82b8d6-25d5-49b0-a005-b56f6eba32c3 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186" status: 200 len: 1723 microversion: 2.1 time: 0.139667 Aug 07 05:06:56.598292 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 663/1285] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:06:56 2021] GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186 => generated 1723 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:06:57.614463 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-835b9c3c-6ba0-4fd6-aa7f-1a583e14dc23 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:06:57.615068 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-835b9c3c-6ba0-4fd6-aa7f-1a583e14dc23 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:06:57.621385 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-835b9c3c-6ba0-4fd6-aa7f-1a583e14dc23 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:57.621829 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-835b9c3c-6ba0-4fd6-aa7f-1a583e14dc23 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:57.622590 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-835b9c3c-6ba0-4fd6-aa7f-1a583e14dc23 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:57.623022 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-835b9c3c-6ba0-4fd6-aa7f-1a583e14dc23 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:57.741691 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-835b9c3c-6ba0-4fd6-aa7f-1a583e14dc23 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5472ec0a0ae74e9bbf00e2bcf5db21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8063f2f6d64b79928f170fd6d99da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:06:57.749817 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-835b9c3c-6ba0-4fd6-aa7f-1a583e14dc23 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186" status: 200 len: 1723 microversion: 2.1 time: 0.139047 Aug 07 05:06:57.750384 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 623/1286] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:06:57 2021] GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186 => generated 1723 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:06:58.767392 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-d0692917-b9da-4b50-b802-b3c64463ee34 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:06:58.767992 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-d0692917-b9da-4b50-b802-b3c64463ee34 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:06:58.773978 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d0692917-b9da-4b50-b802-b3c64463ee34 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:58.774415 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d0692917-b9da-4b50-b802-b3c64463ee34 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:58.775648 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d0692917-b9da-4b50-b802-b3c64463ee34 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:58.776082 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d0692917-b9da-4b50-b802-b3c64463ee34 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:58.899314 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-d0692917-b9da-4b50-b802-b3c64463ee34 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5472ec0a0ae74e9bbf00e2bcf5db21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8063f2f6d64b79928f170fd6d99da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:06:58.907040 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-d0692917-b9da-4b50-b802-b3c64463ee34 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186" status: 200 len: 1723 microversion: 2.1 time: 0.144009 Aug 07 05:06:58.907596 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 664/1287] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:06:58 2021] GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186 => generated 1723 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:06:59.925180 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-d2b7746c-0680-4d37-b306-3e0c47d2f552 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:06:59.925700 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-d2b7746c-0680-4d37-b306-3e0c47d2f552 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:06:59.931505 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d2b7746c-0680-4d37-b306-3e0c47d2f552 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:59.931949 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d2b7746c-0680-4d37-b306-3e0c47d2f552 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:06:59.932706 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d2b7746c-0680-4d37-b306-3e0c47d2f552 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:06:59.933168 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d2b7746c-0680-4d37-b306-3e0c47d2f552 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:07:00.054712 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-d2b7746c-0680-4d37-b306-3e0c47d2f552 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5472ec0a0ae74e9bbf00e2bcf5db21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8063f2f6d64b79928f170fd6d99da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:07:00.062978 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-d2b7746c-0680-4d37-b306-3e0c47d2f552 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186" status: 200 len: 1723 microversion: 2.1 time: 0.141549 Aug 07 05:07:00.063537 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 624/1288] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:06:59 2021] GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186 => generated 1723 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:07:01.079628 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-09235b47-c34a-4745-97f2-4d587e285c6d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:07:01.080483 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-09235b47-c34a-4745-97f2-4d587e285c6d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:07:01.086654 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-09235b47-c34a-4745-97f2-4d587e285c6d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:07:01.087096 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-09235b47-c34a-4745-97f2-4d587e285c6d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:07:01.087860 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-09235b47-c34a-4745-97f2-4d587e285c6d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:07:01.088285 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-09235b47-c34a-4745-97f2-4d587e285c6d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:07:01.208732 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-09235b47-c34a-4745-97f2-4d587e285c6d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5472ec0a0ae74e9bbf00e2bcf5db21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8063f2f6d64b79928f170fd6d99da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:07:01.216360 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-09235b47-c34a-4745-97f2-4d587e285c6d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186" status: 200 len: 1723 microversion: 2.1 time: 0.140489 Aug 07 05:07:01.217581 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 665/1289] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:07:01 2021] GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186 => generated 1723 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:07:02.233707 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-a9b01e85-6ddf-4af8-8a50-d4c51811739a tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:07:02.234308 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-a9b01e85-6ddf-4af8-8a50-d4c51811739a tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:07:02.240439 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a9b01e85-6ddf-4af8-8a50-d4c51811739a tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:07:02.240899 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a9b01e85-6ddf-4af8-8a50-d4c51811739a tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:07:02.241653 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a9b01e85-6ddf-4af8-8a50-d4c51811739a tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:07:02.242078 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a9b01e85-6ddf-4af8-8a50-d4c51811739a tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:07:02.361145 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-a9b01e85-6ddf-4af8-8a50-d4c51811739a tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5472ec0a0ae74e9bbf00e2bcf5db21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8063f2f6d64b79928f170fd6d99da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:07:02.368689 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-a9b01e85-6ddf-4af8-8a50-d4c51811739a tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186" status: 200 len: 1723 microversion: 2.1 time: 0.138695 Aug 07 05:07:02.369276 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 625/1290] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:07:02 2021] GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186 => generated 1723 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:07:03.386175 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-549d70a7-0c77-4530-a8de-0118dae0f80e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:07:03.386787 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-549d70a7-0c77-4530-a8de-0118dae0f80e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:07:03.392710 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-549d70a7-0c77-4530-a8de-0118dae0f80e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:07:03.393186 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-549d70a7-0c77-4530-a8de-0118dae0f80e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:07:03.393957 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-549d70a7-0c77-4530-a8de-0118dae0f80e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:07:03.394392 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-549d70a7-0c77-4530-a8de-0118dae0f80e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:07:03.517821 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-549d70a7-0c77-4530-a8de-0118dae0f80e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5472ec0a0ae74e9bbf00e2bcf5db21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8063f2f6d64b79928f170fd6d99da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:07:03.525544 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-549d70a7-0c77-4530-a8de-0118dae0f80e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186" status: 200 len: 1723 microversion: 2.1 time: 0.143087 Aug 07 05:07:03.526099 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 666/1291] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:07:03 2021] GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186 => generated 1723 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:07:04.541943 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-893337f8-4020-48fa-b64a-fd846612f16a tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:07:04.542565 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-893337f8-4020-48fa-b64a-fd846612f16a tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:07:04.549013 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-893337f8-4020-48fa-b64a-fd846612f16a tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:07:04.549460 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-893337f8-4020-48fa-b64a-fd846612f16a tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:07:04.550232 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-893337f8-4020-48fa-b64a-fd846612f16a tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:07:04.550751 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-893337f8-4020-48fa-b64a-fd846612f16a tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:07:04.758139 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-893337f8-4020-48fa-b64a-fd846612f16a tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5472ec0a0ae74e9bbf00e2bcf5db21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8063f2f6d64b79928f170fd6d99da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:07:04.766955 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-893337f8-4020-48fa-b64a-fd846612f16a tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186" status: 200 len: 1723 microversion: 2.1 time: 0.228643 Aug 07 05:07:04.767518 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 626/1292] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:07:04 2021] GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186 => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:07:05.784270 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-fc39f151-04ef-4d18-9aeb-e63d890010c9 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:07:05.784894 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-fc39f151-04ef-4d18-9aeb-e63d890010c9 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:07:05.790736 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-fc39f151-04ef-4d18-9aeb-e63d890010c9 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:07:05.791170 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-fc39f151-04ef-4d18-9aeb-e63d890010c9 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:07:05.791924 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-fc39f151-04ef-4d18-9aeb-e63d890010c9 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:07:05.792351 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-fc39f151-04ef-4d18-9aeb-e63d890010c9 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:07:05.911734 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-fc39f151-04ef-4d18-9aeb-e63d890010c9 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5472ec0a0ae74e9bbf00e2bcf5db21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8063f2f6d64b79928f170fd6d99da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:07:05.919413 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-fc39f151-04ef-4d18-9aeb-e63d890010c9 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186" status: 200 len: 1723 microversion: 2.1 time: 0.138791 Aug 07 05:07:05.919976 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 667/1293] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:07:05 2021] GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186 => generated 1723 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 05:07:06.935200 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-a29744c7-6096-4529-a9ab-51a2bdfdd7c4 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:07:06.935766 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-a29744c7-6096-4529-a9ab-51a2bdfdd7c4 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:07:06.941561 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a29744c7-6096-4529-a9ab-51a2bdfdd7c4 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:07:06.942003 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a29744c7-6096-4529-a9ab-51a2bdfdd7c4 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:07:06.942759 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a29744c7-6096-4529-a9ab-51a2bdfdd7c4 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:07:06.943189 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a29744c7-6096-4529-a9ab-51a2bdfdd7c4 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:07:07.060932 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-a29744c7-6096-4529-a9ab-51a2bdfdd7c4 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5472ec0a0ae74e9bbf00e2bcf5db21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8063f2f6d64b79928f170fd6d99da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:07:07.068540 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-a29744c7-6096-4529-a9ab-51a2bdfdd7c4 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186" status: 200 len: 1723 microversion: 2.1 time: 0.137066 Aug 07 05:07:07.069123 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 627/1294] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:07:06 2021] GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186 => generated 1723 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:07:08.086282 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-748fcdd7-fb0a-4d29-80bc-c674c31ab3c5 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:07:08.086888 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-748fcdd7-fb0a-4d29-80bc-c674c31ab3c5 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:07:08.093136 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-748fcdd7-fb0a-4d29-80bc-c674c31ab3c5 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:07:08.093575 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-748fcdd7-fb0a-4d29-80bc-c674c31ab3c5 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:07:08.094329 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-748fcdd7-fb0a-4d29-80bc-c674c31ab3c5 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:07:08.094762 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-748fcdd7-fb0a-4d29-80bc-c674c31ab3c5 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:07:08.215181 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-748fcdd7-fb0a-4d29-80bc-c674c31ab3c5 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5472ec0a0ae74e9bbf00e2bcf5db21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8063f2f6d64b79928f170fd6d99da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:07:08.223387 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-748fcdd7-fb0a-4d29-80bc-c674c31ab3c5 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186" status: 200 len: 1723 microversion: 2.1 time: 0.140788 Aug 07 05:07:08.223950 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 668/1295] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:07:08 2021] GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186 => generated 1723 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:07:09.240600 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-013ec43e-9300-40c9-9987-23a1e6283dc9 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:07:09.241166 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-013ec43e-9300-40c9-9987-23a1e6283dc9 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:07:09.246996 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-013ec43e-9300-40c9-9987-23a1e6283dc9 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:07:09.247428 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-013ec43e-9300-40c9-9987-23a1e6283dc9 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:07:09.248863 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-013ec43e-9300-40c9-9987-23a1e6283dc9 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:07:09.249290 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-013ec43e-9300-40c9-9987-23a1e6283dc9 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:07:09.374047 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-013ec43e-9300-40c9-9987-23a1e6283dc9 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5472ec0a0ae74e9bbf00e2bcf5db21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8063f2f6d64b79928f170fd6d99da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:07:09.381664 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-013ec43e-9300-40c9-9987-23a1e6283dc9 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186" status: 200 len: 1723 microversion: 2.1 time: 0.144768 Aug 07 05:07:09.382223 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 628/1296] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:07:09 2021] GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186 => generated 1723 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:07:10.398060 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-6008738b-4cd0-4cf0-ab7c-008c851b033a tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:07:10.398597 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-6008738b-4cd0-4cf0-ab7c-008c851b033a tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:07:10.404882 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6008738b-4cd0-4cf0-ab7c-008c851b033a tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:07:10.405324 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6008738b-4cd0-4cf0-ab7c-008c851b033a tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:07:10.406077 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6008738b-4cd0-4cf0-ab7c-008c851b033a tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:07:10.406505 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6008738b-4cd0-4cf0-ab7c-008c851b033a tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:07:10.523451 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-6008738b-4cd0-4cf0-ab7c-008c851b033a tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5472ec0a0ae74e9bbf00e2bcf5db21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8063f2f6d64b79928f170fd6d99da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:07:10.531229 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-6008738b-4cd0-4cf0-ab7c-008c851b033a tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186" status: 200 len: 1700 microversion: 2.1 time: 0.136884 Aug 07 05:07:10.531787 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 669/1297] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:07:10 2021] GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186 => generated 1700 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:07:10.547824 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-69e38b98-3c7d-4893-835f-e78569bfc90d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:07:10.554012 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-69e38b98-3c7d-4893-835f-e78569bfc90d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:07:10.554443 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-69e38b98-3c7d-4893-835f-e78569bfc90d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:07:10.576936 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-69e38b98-3c7d-4893-835f-e78569bfc90d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Going to try to start instance {{(pid=107485) start /opt/stack/nova/nova/compute/api.py:2603}} Aug 07 05:07:10.617129 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-69e38b98-3c7d-4893-835f-e78569bfc90d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 202 len: 0 microversion: 2.1 time: 0.073328 Aug 07 05:07:10.617727 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 629/1298] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:07:10 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:07:10.627028 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-6b0787a6-ef6b-4854-bdfe-156f3f4685fa tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:07:10.627642 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-6b0787a6-ef6b-4854-bdfe-156f3f4685fa tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:07:10.634074 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6b0787a6-ef6b-4854-bdfe-156f3f4685fa tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:07:10.634530 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6b0787a6-ef6b-4854-bdfe-156f3f4685fa tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:07:10.635322 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6b0787a6-ef6b-4854-bdfe-156f3f4685fa tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:07:10.635787 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6b0787a6-ef6b-4854-bdfe-156f3f4685fa tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:07:10.756007 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-6b0787a6-ef6b-4854-bdfe-156f3f4685fa tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5472ec0a0ae74e9bbf00e2bcf5db21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8063f2f6d64b79928f170fd6d99da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:07:10.764262 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-6b0787a6-ef6b-4854-bdfe-156f3f4685fa tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186" status: 200 len: 1709 microversion: 2.1 time: 0.142194 Aug 07 05:07:10.764866 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 670/1299] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:07:10 2021] GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186 => generated 1709 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 05:07:11.781932 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-562a86b0-d1db-4800-8883-73c32d3735f8 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:07:11.782654 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-562a86b0-d1db-4800-8883-73c32d3735f8 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:07:11.789102 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-562a86b0-d1db-4800-8883-73c32d3735f8 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:07:11.789553 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-562a86b0-d1db-4800-8883-73c32d3735f8 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:07:11.790352 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-562a86b0-d1db-4800-8883-73c32d3735f8 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:07:11.790789 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-562a86b0-d1db-4800-8883-73c32d3735f8 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:07:11.913215 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-562a86b0-d1db-4800-8883-73c32d3735f8 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5472ec0a0ae74e9bbf00e2bcf5db21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8063f2f6d64b79928f170fd6d99da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:07:11.921562 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-562a86b0-d1db-4800-8883-73c32d3735f8 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186" status: 200 len: 1709 microversion: 2.1 time: 0.143853 Aug 07 05:07:11.922117 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 630/1300] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:07:11 2021] GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186 => generated 1709 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:07:12.938945 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-46131332-b698-427d-89be-f9822b50ffdd tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:07:12.939486 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-46131332-b698-427d-89be-f9822b50ffdd tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:07:12.945313 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-46131332-b698-427d-89be-f9822b50ffdd tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:07:12.945774 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-46131332-b698-427d-89be-f9822b50ffdd tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:07:12.946521 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-46131332-b698-427d-89be-f9822b50ffdd tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:07:12.946952 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-46131332-b698-427d-89be-f9822b50ffdd tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:07:13.069337 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-46131332-b698-427d-89be-f9822b50ffdd tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5472ec0a0ae74e9bbf00e2bcf5db21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8063f2f6d64b79928f170fd6d99da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:07:13.077729 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-46131332-b698-427d-89be-f9822b50ffdd tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186" status: 200 len: 1713 microversion: 2.1 time: 0.143170 Aug 07 05:07:13.078283 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 671/1301] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:07:12 2021] GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186 => generated 1713 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:08:08.519534 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-fa6a4d87-8f9c-46ad-8fc8-0c52d2539260 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:08:08.520168 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-fa6a4d87-8f9c-46ad-8fc8-0c52d2539260 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:08:08.526128 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-fa6a4d87-8f9c-46ad-8fc8-0c52d2539260 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:08:08.526580 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-fa6a4d87-8f9c-46ad-8fc8-0c52d2539260 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:08:08.527347 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-fa6a4d87-8f9c-46ad-8fc8-0c52d2539260 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:08:08.527775 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-fa6a4d87-8f9c-46ad-8fc8-0c52d2539260 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:08:08.610147 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.objects.instance [None req-fa6a4d87-8f9c-46ad-8fc8-0c52d2539260 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lazy-loading 'services' on Instance uuid e3ca5865-7170-4012-b7fa-3c65e878a186 {{(pid=107485) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 05:08:08.675547 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-fa6a4d87-8f9c-46ad-8fc8-0c52d2539260 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "DELETE /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/os-volume_attachments/f55121ea-8c9e-47b0-91e0-6ba34f25fced" status: 202 len: 0 microversion: 2.1 time: 0.159608 Aug 07 05:08:08.676137 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 631/1302] 10.222.0.35 () {58 vars in 1416 bytes} [Sat Aug 7 05:08:08 2021] DELETE /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/os-volume_attachments/f55121ea-8c9e-47b0-91e0-6ba34f25fced => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:08:09.793912 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-2bd206b4-6199-4def-9882-a3f22e5230cc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:08:09.800805 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2bd206b4-6199-4def-9882-a3f22e5230cc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:08:09.801252 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2bd206b4-6199-4def-9882-a3f22e5230cc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:08:09.860934 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-2bd206b4-6199-4def-9882-a3f22e5230cc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Going to try to stop instance {{(pid=107486) force_stop /opt/stack/nova/nova/compute/api.py:2580}} Aug 07 05:08:09.902321 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-2bd206b4-6199-4def-9882-a3f22e5230cc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 202 len: 0 microversion: 2.1 time: 0.111912 Aug 07 05:08:09.902891 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 672/1303] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:08:09 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:08:09.911311 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-50f96d51-cf37-4ab2-99af-0ddcdffc0d11 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:08:09.912000 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-50f96d51-cf37-4ab2-99af-0ddcdffc0d11 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:08:09.918313 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-50f96d51-cf37-4ab2-99af-0ddcdffc0d11 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:08:09.918819 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-50f96d51-cf37-4ab2-99af-0ddcdffc0d11 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:08:09.919594 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-50f96d51-cf37-4ab2-99af-0ddcdffc0d11 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:08:09.920024 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-50f96d51-cf37-4ab2-99af-0ddcdffc0d11 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:08:10.039086 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-50f96d51-cf37-4ab2-99af-0ddcdffc0d11 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5472ec0a0ae74e9bbf00e2bcf5db21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8063f2f6d64b79928f170fd6d99da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:08:10.046389 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-50f96d51-cf37-4ab2-99af-0ddcdffc0d11 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186" status: 200 len: 1677 microversion: 2.1 time: 0.139231 Aug 07 05:08:10.046950 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 632/1304] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:08:09 2021] GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186 => generated 1677 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:08:11.064251 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-af2fec34-978c-4ba2-85d5-8079d82feffa tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:08:11.065487 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-af2fec34-978c-4ba2-85d5-8079d82feffa tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:08:11.071659 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-af2fec34-978c-4ba2-85d5-8079d82feffa tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:08:11.072102 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-af2fec34-978c-4ba2-85d5-8079d82feffa tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:08:11.072910 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-af2fec34-978c-4ba2-85d5-8079d82feffa tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:08:11.073345 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-af2fec34-978c-4ba2-85d5-8079d82feffa tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:08:11.196502 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-af2fec34-978c-4ba2-85d5-8079d82feffa tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5472ec0a0ae74e9bbf00e2bcf5db21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8063f2f6d64b79928f170fd6d99da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:08:11.203703 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-af2fec34-978c-4ba2-85d5-8079d82feffa tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186" status: 200 len: 1677 microversion: 2.1 time: 0.143476 Aug 07 05:08:11.204264 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 673/1305] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:08:11 2021] GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186 => generated 1677 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:08:12.222425 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-8b9f732a-99a9-4a1b-862e-4b56db586361 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:08:12.223047 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-8b9f732a-99a9-4a1b-862e-4b56db586361 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:08:12.228906 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8b9f732a-99a9-4a1b-862e-4b56db586361 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:08:12.229353 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8b9f732a-99a9-4a1b-862e-4b56db586361 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:08:12.230116 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8b9f732a-99a9-4a1b-862e-4b56db586361 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:08:12.230548 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8b9f732a-99a9-4a1b-862e-4b56db586361 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:08:12.351666 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-8b9f732a-99a9-4a1b-862e-4b56db586361 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5472ec0a0ae74e9bbf00e2bcf5db21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8063f2f6d64b79928f170fd6d99da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:08:12.358902 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-8b9f732a-99a9-4a1b-862e-4b56db586361 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186" status: 200 len: 1677 microversion: 2.1 time: 0.141384 Aug 07 05:08:12.359466 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 633/1306] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:08:12 2021] GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186 => generated 1677 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:08:13.375833 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-b4ec4688-ca73-4154-9812-8fa128a4b763 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:08:13.376445 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-b4ec4688-ca73-4154-9812-8fa128a4b763 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:08:13.382533 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b4ec4688-ca73-4154-9812-8fa128a4b763 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:08:13.382979 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b4ec4688-ca73-4154-9812-8fa128a4b763 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:08:13.383741 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b4ec4688-ca73-4154-9812-8fa128a4b763 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:08:13.384173 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-b4ec4688-ca73-4154-9812-8fa128a4b763 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:08:13.501212 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-b4ec4688-ca73-4154-9812-8fa128a4b763 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5472ec0a0ae74e9bbf00e2bcf5db21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8063f2f6d64b79928f170fd6d99da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:08:13.508889 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-b4ec4688-ca73-4154-9812-8fa128a4b763 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186" status: 200 len: 1677 microversion: 2.1 time: 0.136712 Aug 07 05:08:13.509446 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 674/1307] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:08:13 2021] GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186 => generated 1677 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:08:14.526154 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-c2836538-69a4-4d5c-8587-2bf32618d09f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:08:14.526743 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-c2836538-69a4-4d5c-8587-2bf32618d09f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:08:14.532608 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c2836538-69a4-4d5c-8587-2bf32618d09f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:08:14.533076 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c2836538-69a4-4d5c-8587-2bf32618d09f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:08:14.533838 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c2836538-69a4-4d5c-8587-2bf32618d09f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:08:14.534270 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c2836538-69a4-4d5c-8587-2bf32618d09f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:08:14.652765 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-c2836538-69a4-4d5c-8587-2bf32618d09f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5472ec0a0ae74e9bbf00e2bcf5db21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8063f2f6d64b79928f170fd6d99da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:08:14.660626 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-c2836538-69a4-4d5c-8587-2bf32618d09f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186" status: 200 len: 1677 microversion: 2.1 time: 0.138162 Aug 07 05:08:14.661218 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 634/1308] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:08:14 2021] GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186 => generated 1677 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:08:15.677285 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-ed28a67e-0c45-4da1-864e-f3fbcc68d569 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:08:15.677890 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-ed28a67e-0c45-4da1-864e-f3fbcc68d569 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:08:15.683747 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ed28a67e-0c45-4da1-864e-f3fbcc68d569 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:08:15.684191 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ed28a67e-0c45-4da1-864e-f3fbcc68d569 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:08:15.684996 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ed28a67e-0c45-4da1-864e-f3fbcc68d569 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:08:15.685426 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ed28a67e-0c45-4da1-864e-f3fbcc68d569 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:08:15.807403 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-ed28a67e-0c45-4da1-864e-f3fbcc68d569 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5472ec0a0ae74e9bbf00e2bcf5db21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8063f2f6d64b79928f170fd6d99da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:08:15.814546 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-ed28a67e-0c45-4da1-864e-f3fbcc68d569 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186" status: 200 len: 1677 microversion: 2.1 time: 0.140954 Aug 07 05:08:15.815719 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 675/1309] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:08:15 2021] GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186 => generated 1677 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:08:16.832371 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-1d57bb3f-c135-4f3d-bf65-fbccdda29d34 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:08:16.833043 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-1d57bb3f-c135-4f3d-bf65-fbccdda29d34 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:08:16.838884 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1d57bb3f-c135-4f3d-bf65-fbccdda29d34 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:08:16.839334 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1d57bb3f-c135-4f3d-bf65-fbccdda29d34 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:08:16.840103 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1d57bb3f-c135-4f3d-bf65-fbccdda29d34 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:08:16.840537 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1d57bb3f-c135-4f3d-bf65-fbccdda29d34 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:08:16.958071 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-1d57bb3f-c135-4f3d-bf65-fbccdda29d34 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5472ec0a0ae74e9bbf00e2bcf5db21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8063f2f6d64b79928f170fd6d99da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:08:16.965399 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-1d57bb3f-c135-4f3d-bf65-fbccdda29d34 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186" status: 200 len: 1677 microversion: 2.1 time: 0.137018 Aug 07 05:08:16.965969 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 635/1310] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:08:16 2021] GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186 => generated 1677 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:08:17.986088 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-4ced1d91-630e-462f-8008-9abd3deb2ed7 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:08:17.986610 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-4ced1d91-630e-462f-8008-9abd3deb2ed7 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:08:17.997047 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4ced1d91-630e-462f-8008-9abd3deb2ed7 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:08:17.997502 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4ced1d91-630e-462f-8008-9abd3deb2ed7 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:08:17.998281 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4ced1d91-630e-462f-8008-9abd3deb2ed7 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:08:17.998717 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4ced1d91-630e-462f-8008-9abd3deb2ed7 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:08:18.117882 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-4ced1d91-630e-462f-8008-9abd3deb2ed7 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5472ec0a0ae74e9bbf00e2bcf5db21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8063f2f6d64b79928f170fd6d99da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:08:18.125079 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-4ced1d91-630e-462f-8008-9abd3deb2ed7 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186" status: 200 len: 1677 microversion: 2.1 time: 0.142678 Aug 07 05:08:18.125644 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 676/1311] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:08:17 2021] GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186 => generated 1677 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:08:19.142015 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-6fa0af3b-857f-4241-a91a-73d8ab5cf1cc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:08:19.142623 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-6fa0af3b-857f-4241-a91a-73d8ab5cf1cc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:08:19.148764 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6fa0af3b-857f-4241-a91a-73d8ab5cf1cc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:08:19.148764 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6fa0af3b-857f-4241-a91a-73d8ab5cf1cc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:08:19.150132 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6fa0af3b-857f-4241-a91a-73d8ab5cf1cc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:08:19.150557 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6fa0af3b-857f-4241-a91a-73d8ab5cf1cc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:08:19.272655 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-6fa0af3b-857f-4241-a91a-73d8ab5cf1cc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5472ec0a0ae74e9bbf00e2bcf5db21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8063f2f6d64b79928f170fd6d99da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:08:19.279819 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-6fa0af3b-857f-4241-a91a-73d8ab5cf1cc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186" status: 200 len: 1677 microversion: 2.1 time: 0.141718 Aug 07 05:08:19.280379 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 636/1312] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:08:19 2021] GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186 => generated 1677 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:08:20.297296 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-bfc32046-d6b0-4e17-b556-ab7f7792465f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:08:20.297893 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-bfc32046-d6b0-4e17-b556-ab7f7792465f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:08:20.304357 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-bfc32046-d6b0-4e17-b556-ab7f7792465f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:08:20.304815 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-bfc32046-d6b0-4e17-b556-ab7f7792465f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:08:20.305576 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-bfc32046-d6b0-4e17-b556-ab7f7792465f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:08:20.306003 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-bfc32046-d6b0-4e17-b556-ab7f7792465f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:08:20.425632 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-bfc32046-d6b0-4e17-b556-ab7f7792465f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5472ec0a0ae74e9bbf00e2bcf5db21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8063f2f6d64b79928f170fd6d99da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:08:20.432767 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-bfc32046-d6b0-4e17-b556-ab7f7792465f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186" status: 200 len: 1677 microversion: 2.1 time: 0.139088 Aug 07 05:08:20.433350 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 677/1313] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:08:20 2021] GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186 => generated 1677 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:08:21.450130 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-7915b51f-ca62-4a53-9c3c-7b4dc80eec0e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:08:21.450721 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-7915b51f-ca62-4a53-9c3c-7b4dc80eec0e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:08:21.457588 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7915b51f-ca62-4a53-9c3c-7b4dc80eec0e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:08:21.458031 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7915b51f-ca62-4a53-9c3c-7b4dc80eec0e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:08:21.458792 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7915b51f-ca62-4a53-9c3c-7b4dc80eec0e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:08:21.459221 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7915b51f-ca62-4a53-9c3c-7b4dc80eec0e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:08:21.577262 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-7915b51f-ca62-4a53-9c3c-7b4dc80eec0e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5472ec0a0ae74e9bbf00e2bcf5db21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8063f2f6d64b79928f170fd6d99da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:08:21.585448 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-7915b51f-ca62-4a53-9c3c-7b4dc80eec0e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186" status: 200 len: 1677 microversion: 2.1 time: 0.139063 Aug 07 05:08:21.586017 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 637/1314] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:08:21 2021] GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186 => generated 1677 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:08:22.602348 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-cf32a1f6-2741-419d-84c9-e65d54804945 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:08:22.603062 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-cf32a1f6-2741-419d-84c9-e65d54804945 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:08:22.608936 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-cf32a1f6-2741-419d-84c9-e65d54804945 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:08:22.609380 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-cf32a1f6-2741-419d-84c9-e65d54804945 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:08:22.610142 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-cf32a1f6-2741-419d-84c9-e65d54804945 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:08:22.610571 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-cf32a1f6-2741-419d-84c9-e65d54804945 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:08:22.733298 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-cf32a1f6-2741-419d-84c9-e65d54804945 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5472ec0a0ae74e9bbf00e2bcf5db21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8063f2f6d64b79928f170fd6d99da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:08:22.741165 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-cf32a1f6-2741-419d-84c9-e65d54804945 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186" status: 200 len: 1677 microversion: 2.1 time: 0.142529 Aug 07 05:08:22.741716 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 678/1315] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:08:22 2021] GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186 => generated 1677 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:08:23.758159 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-238a0042-e016-4e97-9bf7-b32af1a4713d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:08:23.758760 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-238a0042-e016-4e97-9bf7-b32af1a4713d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:08:23.764480 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-238a0042-e016-4e97-9bf7-b32af1a4713d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:08:23.764961 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-238a0042-e016-4e97-9bf7-b32af1a4713d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:08:23.765728 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-238a0042-e016-4e97-9bf7-b32af1a4713d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:08:23.766141 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-238a0042-e016-4e97-9bf7-b32af1a4713d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:08:23.884978 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-238a0042-e016-4e97-9bf7-b32af1a4713d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5472ec0a0ae74e9bbf00e2bcf5db21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8063f2f6d64b79928f170fd6d99da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:08:23.892157 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-238a0042-e016-4e97-9bf7-b32af1a4713d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186" status: 200 len: 1677 microversion: 2.1 time: 0.137679 Aug 07 05:08:23.892714 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 638/1316] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:08:23 2021] GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186 => generated 1677 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:08:24.908166 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-07cd8835-790d-4be8-89d4-9203e53699a6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:08:24.908768 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-07cd8835-790d-4be8-89d4-9203e53699a6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:08:24.914654 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-07cd8835-790d-4be8-89d4-9203e53699a6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:08:24.915090 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-07cd8835-790d-4be8-89d4-9203e53699a6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:08:24.915837 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-07cd8835-790d-4be8-89d4-9203e53699a6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:08:24.916258 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-07cd8835-790d-4be8-89d4-9203e53699a6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:08:25.033880 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-07cd8835-790d-4be8-89d4-9203e53699a6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5472ec0a0ae74e9bbf00e2bcf5db21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8063f2f6d64b79928f170fd6d99da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:08:25.041132 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-07cd8835-790d-4be8-89d4-9203e53699a6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186" status: 200 len: 1677 microversion: 2.1 time: 0.136670 Aug 07 05:08:25.041681 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 679/1317] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:08:24 2021] GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186 => generated 1677 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:08:26.059174 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-b179446e-38d7-4103-b90e-603fbf855551 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:08:26.059713 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-b179446e-38d7-4103-b90e-603fbf855551 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:08:26.065696 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b179446e-38d7-4103-b90e-603fbf855551 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:08:26.066135 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b179446e-38d7-4103-b90e-603fbf855551 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:08:26.066892 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b179446e-38d7-4103-b90e-603fbf855551 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:08:26.067321 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b179446e-38d7-4103-b90e-603fbf855551 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:08:26.187828 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-b179446e-38d7-4103-b90e-603fbf855551 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5472ec0a0ae74e9bbf00e2bcf5db21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8063f2f6d64b79928f170fd6d99da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:08:26.195659 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-b179446e-38d7-4103-b90e-603fbf855551 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186" status: 200 len: 1654 microversion: 2.1 time: 0.140288 Aug 07 05:08:26.196214 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 639/1318] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:08:26 2021] GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186 => generated 1654 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:08:26.212288 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-d1ff169d-ad34-4fcc-8539-ceb1f054d18e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:08:26.218067 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d1ff169d-ad34-4fcc-8539-ceb1f054d18e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:08:26.218503 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d1ff169d-ad34-4fcc-8539-ceb1f054d18e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:08:26.239818 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-d1ff169d-ad34-4fcc-8539-ceb1f054d18e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Going to try to start instance {{(pid=107486) start /opt/stack/nova/nova/compute/api.py:2603}} Aug 07 05:08:26.279129 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-d1ff169d-ad34-4fcc-8539-ceb1f054d18e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action" status: 202 len: 0 microversion: 2.1 time: 0.070249 Aug 07 05:08:26.279671 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 680/1319] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:08:26 2021] POST /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/action => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:08:26.287613 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-fd176b62-a982-4392-9d39-bc129ce63bba tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:08:26.288229 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-fd176b62-a982-4392-9d39-bc129ce63bba tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:08:26.294140 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-fd176b62-a982-4392-9d39-bc129ce63bba tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:08:26.294568 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-fd176b62-a982-4392-9d39-bc129ce63bba tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:08:26.295390 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-fd176b62-a982-4392-9d39-bc129ce63bba tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:08:26.295799 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-fd176b62-a982-4392-9d39-bc129ce63bba tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:08:26.418738 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-fd176b62-a982-4392-9d39-bc129ce63bba tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5472ec0a0ae74e9bbf00e2bcf5db21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8063f2f6d64b79928f170fd6d99da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:08:26.426897 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-fd176b62-a982-4392-9d39-bc129ce63bba tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186" status: 200 len: 1663 microversion: 2.1 time: 0.142934 Aug 07 05:08:26.427474 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 640/1320] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:08:26 2021] GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186 => generated 1663 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:08:27.445563 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-aa7558e3-e6ae-4710-ae9d-af3e5862a837 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:08:27.446263 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-aa7558e3-e6ae-4710-ae9d-af3e5862a837 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:08:27.452241 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-aa7558e3-e6ae-4710-ae9d-af3e5862a837 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:08:27.452686 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-aa7558e3-e6ae-4710-ae9d-af3e5862a837 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:08:27.453478 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-aa7558e3-e6ae-4710-ae9d-af3e5862a837 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:08:27.453911 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-aa7558e3-e6ae-4710-ae9d-af3e5862a837 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:08:27.575128 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-aa7558e3-e6ae-4710-ae9d-af3e5862a837 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5472ec0a0ae74e9bbf00e2bcf5db21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8063f2f6d64b79928f170fd6d99da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:08:27.583949 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-aa7558e3-e6ae-4710-ae9d-af3e5862a837 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186" status: 200 len: 1663 microversion: 2.1 time: 0.143882 Aug 07 05:08:27.584522 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 681/1321] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:08:27 2021] GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186 => generated 1663 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:08:28.602428 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-d280b80a-b28b-4837-9594-072c457d96c6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:08:28.603046 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-d280b80a-b28b-4837-9594-072c457d96c6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:08:28.612692 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d280b80a-b28b-4837-9594-072c457d96c6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:08:28.613282 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d280b80a-b28b-4837-9594-072c457d96c6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:08:28.614285 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d280b80a-b28b-4837-9594-072c457d96c6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:08:28.614730 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d280b80a-b28b-4837-9594-072c457d96c6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:08:28.732621 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-d280b80a-b28b-4837-9594-072c457d96c6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5472ec0a0ae74e9bbf00e2bcf5db21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8063f2f6d64b79928f170fd6d99da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:08:28.740600 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-d280b80a-b28b-4837-9594-072c457d96c6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186" status: 200 len: 1667 microversion: 2.1 time: 0.144010 Aug 07 05:08:28.741183 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 641/1322] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:08:28 2021] GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186 => generated 1667 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:08:42.192745 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 05:08:42.193458 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: Sat Aug 7 05:08:42 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 05:08:49.230967 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 05:08:49.231535 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: Sat Aug 7 05:08:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 05:09:31.964493 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-d4f24194-f61c-4deb-bc84-968dc99fed1a tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:09:31.965541 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-d4f24194-f61c-4deb-bc84-968dc99fed1a tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:09:31.971636 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d4f24194-f61c-4deb-bc84-968dc99fed1a tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:09:31.972078 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d4f24194-f61c-4deb-bc84-968dc99fed1a tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:09:31.972863 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d4f24194-f61c-4deb-bc84-968dc99fed1a tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:09:31.973296 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d4f24194-f61c-4deb-bc84-968dc99fed1a tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:09:32.001764 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-d4f24194-f61c-4deb-bc84-968dc99fed1a tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041203 Aug 07 05:09:32.002298 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 682/1323] 10.222.0.35 () {58 vars in 1302 bytes} [Sat Aug 7 05:09:31 2021] GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 05:09:32.061457 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b2f3e8fe-f2eb-433e-81aa-98acf8a082e1] AMQP server on 10.222.0.35:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 07 05:09:32.065715 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-cd3b89d7-8c79-4b9c-a7dd-4c517c3c7bed tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:09:32.066237 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-cd3b89d7-8c79-4b9c-a7dd-4c517c3c7bed tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:09:32.072134 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-cd3b89d7-8c79-4b9c-a7dd-4c517c3c7bed tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:09:32.072576 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-cd3b89d7-8c79-4b9c-a7dd-4c517c3c7bed tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:09:32.073365 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-cd3b89d7-8c79-4b9c-a7dd-4c517c3c7bed tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:09:32.073796 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-cd3b89d7-8c79-4b9c-a7dd-4c517c3c7bed tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:09:32.098859 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-cd3b89d7-8c79-4b9c-a7dd-4c517c3c7bed tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Going to try to terminate instance {{(pid=107485) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 07 05:09:32.170590 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-cd3b89d7-8c79-4b9c-a7dd-4c517c3c7bed tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "DELETE /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186" status: 204 len: 0 microversion: 2.1 time: 0.110599 Aug 07 05:09:32.171231 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 642/1324] 10.222.0.35 () {58 vars in 1239 bytes} [Sat Aug 7 05:09:32 2021] DELETE /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 05:09:32.179580 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-9df07554-c6d3-4a62-97ec-ebac92196e0b tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:09:32.180187 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-9df07554-c6d3-4a62-97ec-ebac92196e0b tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:09:32.186037 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9df07554-c6d3-4a62-97ec-ebac92196e0b tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:09:32.186478 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9df07554-c6d3-4a62-97ec-ebac92196e0b tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:09:32.187241 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9df07554-c6d3-4a62-97ec-ebac92196e0b tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:09:32.187673 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9df07554-c6d3-4a62-97ec-ebac92196e0b tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:09:32.523663 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-9df07554-c6d3-4a62-97ec-ebac92196e0b tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5472ec0a0ae74e9bbf00e2bcf5db21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8063f2f6d64b79928f170fd6d99da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:09:32.530872 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-9df07554-c6d3-4a62-97ec-ebac92196e0b tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186" status: 200 len: 1673 microversion: 2.1 time: 0.354938 Aug 07 05:09:32.531478 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 683/1325] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:09:32 2021] GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186 => generated 1673 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:09:33.549082 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-dd9db591-8e9e-4ed5-b333-580b842efbc9 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:09:33.549779 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-dd9db591-8e9e-4ed5-b333-580b842efbc9 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:09:33.566860 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-dd9db591-8e9e-4ed5-b333-580b842efbc9 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:09:33.567304 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-dd9db591-8e9e-4ed5-b333-580b842efbc9 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:09:33.568067 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-dd9db591-8e9e-4ed5-b333-580b842efbc9 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:09:33.568504 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-dd9db591-8e9e-4ed5-b333-580b842efbc9 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:09:33.583982 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO oslo.messaging._drivers.impl_rabbit [-] [b2f3e8fe-f2eb-433e-81aa-98acf8a082e1] Reconnected to AMQP server on 10.222.0.35:5672 via [amqp] client with port 55286. Aug 07 05:09:33.747317 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-dd9db591-8e9e-4ed5-b333-580b842efbc9 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5472ec0a0ae74e9bbf00e2bcf5db21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8063f2f6d64b79928f170fd6d99da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:09:33.754870 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-dd9db591-8e9e-4ed5-b333-580b842efbc9 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186" status: 200 len: 1673 microversion: 2.1 time: 0.210937 Aug 07 05:09:33.755432 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 643/1326] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:09:33 2021] GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186 => generated 1673 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:09:34.771635 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-3757ef40-eb12-428c-b929-ac5af7b3b46e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:09:34.772185 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-3757ef40-eb12-428c-b929-ac5af7b3b46e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:09:34.778055 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3757ef40-eb12-428c-b929-ac5af7b3b46e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:09:34.778506 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3757ef40-eb12-428c-b929-ac5af7b3b46e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:09:34.779276 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3757ef40-eb12-428c-b929-ac5af7b3b46e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:09:34.779704 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3757ef40-eb12-428c-b929-ac5af7b3b46e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:09:34.899153 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-3757ef40-eb12-428c-b929-ac5af7b3b46e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5472ec0a0ae74e9bbf00e2bcf5db21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8063f2f6d64b79928f170fd6d99da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:09:34.906410 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-3757ef40-eb12-428c-b929-ac5af7b3b46e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186" status: 200 len: 1673 microversion: 2.1 time: 0.138655 Aug 07 05:09:34.907498 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 684/1327] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:09:34 2021] GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186 => generated 1673 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:09:35.269455 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [req-72b4c147-9379-439e-a36c-9752aedc2337 req-d8d7dfd8-ba52-4624-95dd-26abfc7a2cad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3ca5865-7170-4012-b7fa-3c65e878a186", "name": "network-vif-deleted", "tag": "0b0cfcc6-8a0f-4a90-98ec-937bbc471bc2"}]} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:09:35.271413 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 05:09:35.271413 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: warnings.warn(msg) Aug 07 05:09:35.279073 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-72b4c147-9379-439e-a36c-9752aedc2337 req-d8d7dfd8-ba52-4624-95dd-26abfc7a2cad service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:09:35.279440 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-72b4c147-9379-439e-a36c-9752aedc2337 req-d8d7dfd8-ba52-4624-95dd-26abfc7a2cad service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:09:35.293543 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.compute.server_external_events [req-72b4c147-9379-439e-a36c-9752aedc2337 req-d8d7dfd8-ba52-4624-95dd-26abfc7a2cad service nova] Creating event network-vif-deleted:0b0cfcc6-8a0f-4a90-98ec-937bbc471bc2 for instance e3ca5865-7170-4012-b7fa-3c65e878a186 on hv-cinder-80374 Aug 07 05:09:35.299690 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [req-72b4c147-9379-439e-a36c-9752aedc2337 req-d8d7dfd8-ba52-4624-95dd-26abfc7a2cad service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033666 Aug 07 05:09:35.300551 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 644/1328] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 05:09:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 05:09:35.923464 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-ae21d2cd-2060-4384-acb7-a1e9e7ddf12e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:09:35.924073 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-ae21d2cd-2060-4384-acb7-a1e9e7ddf12e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:09:35.929921 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ae21d2cd-2060-4384-acb7-a1e9e7ddf12e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:09:35.930362 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ae21d2cd-2060-4384-acb7-a1e9e7ddf12e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:09:35.931128 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ae21d2cd-2060-4384-acb7-a1e9e7ddf12e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:09:35.931561 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ae21d2cd-2060-4384-acb7-a1e9e7ddf12e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:09:35.946617 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.wsgi [None req-ae21d2cd-2060-4384-acb7-a1e9e7ddf12e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] HTTP exception thrown: Instance e3ca5865-7170-4012-b7fa-3c65e878a186 could not be found. Aug 07 05:09:35.947217 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-ae21d2cd-2060-4384-acb7-a1e9e7ddf12e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Returning 404 to user: Instance e3ca5865-7170-4012-b7fa-3c65e878a186 could not be found. {{(pid=107486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 07 05:09:35.948054 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-ae21d2cd-2060-4384-acb7-a1e9e7ddf12e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186" status: 404 len: 111 microversion: 2.1 time: 0.028490 Aug 07 05:09:35.948598 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 685/1329] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:09:35 2021] GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 05:09:35.958597 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-586969a6-b67e-4937-96eb-e9006eedc7e6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '.version_select at 0x7f75ebf3aee0>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:09:35.979511 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-586969a6-b67e-4937-96eb-e9006eedc7e6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1624366041" status: 202 len: 0 microversion: 2.1 time: 0.026084 Aug 07 05:09:35.980087 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 645/1330] 10.222.0.35 () {58 vars in 1221 bytes} [Sat Aug 7 05:09:35 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1624366041 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:09:36.894660 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-33b6d03f-afab-4075-a658-063ddb6a5934 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'create', calling method: .version_select at 0x7f75fcda33a0>, body: {"keypair": {"name": "tempest-keypair-2090056158"}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:09:36.912325 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.quota [None req-33b6d03f-afab-4075-a658-063ddb6a5934 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Getting quotas for project 7a8063f2f6d64b79928f170fd6d99da8. Resources: {'key_pairs'} {{(pid=107486) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 07 05:09:36.916124 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.quota [None req-33b6d03f-afab-4075-a658-063ddb6a5934 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Getting quotas for user 5472ec0a0ae74e9bbf00e2bcf5db21c4 and project 7a8063f2f6d64b79928f170fd6d99da8. Resources: {'key_pairs'} {{(pid=107486) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 07 05:09:36.927554 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: ERROR oslo.messaging._drivers.impl_rabbit [None req-33b6d03f-afab-4075-a658-063ddb6a5934 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [7fa2029d-6165-42be-8823-0e98100d3e8e] AMQP server on 10.222.0.35:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 07 05:09:37.942420 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO oslo.messaging._drivers.impl_rabbit [None req-33b6d03f-afab-4075-a658-063ddb6a5934 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [7fa2029d-6165-42be-8823-0e98100d3e8e] Reconnected to AMQP server on 10.222.0.35:5672 via [amqp] client with port 55308. Aug 07 05:09:38.152577 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.quota [None req-33b6d03f-afab-4075-a658-063ddb6a5934 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Getting quotas for project 7a8063f2f6d64b79928f170fd6d99da8. Resources: {'key_pairs'} {{(pid=107486) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 07 05:09:38.156156 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.quota [None req-33b6d03f-afab-4075-a658-063ddb6a5934 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Getting quotas for user 5472ec0a0ae74e9bbf00e2bcf5db21c4 and project 7a8063f2f6d64b79928f170fd6d99da8. Resources: {'key_pairs'} {{(pid=107486) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 07 05:09:38.169183 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-33b6d03f-afab-4075-a658-063ddb6a5934 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 1.278805 Aug 07 05:09:38.169760 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 686/1331] 10.222.0.35 () {60 vars in 1158 bytes} [Sat Aug 7 05:09:36 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:09:39.425135 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-f2d30649-1a5c-46b8-a79f-8d77d56ffa85 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-840117321", "imageRef": "ddcf95b5-3ea4-4a61-8f54-4b2feadb8682", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7b8fc873-e06a-4d98-b60f-c7f19b5cc694"}], "security_groups": [{"name": "tempest-securitygroup--88720508"}], "key_name": "tempest-keypair-2090056158", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:09:39.514622 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.network.neutron [None req-f2d30649-1a5c-46b8-a79f-8d77d56ffa85 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] validate_networks() for [('7b8fc873-e06a-4d98-b60f-c7f19b5cc694', None, None, None)] {{(pid=107485) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 07 05:09:39.875014 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.virt.hardware [None req-f2d30649-1a5c-46b8-a79f-8d77d56ffa85 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Flavor limits 0:0:0 {{(pid=107485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 05:09:39.875448 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.virt.hardware [None req-f2d30649-1a5c-46b8-a79f-8d77d56ffa85 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Image limits 0:0:0 {{(pid=107485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 05:09:39.876162 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.virt.hardware [None req-f2d30649-1a5c-46b8-a79f-8d77d56ffa85 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Flavor pref 0:0:0 {{(pid=107485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 05:09:39.876614 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.virt.hardware [None req-f2d30649-1a5c-46b8-a79f-8d77d56ffa85 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Image pref 0:0:0 {{(pid=107485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 05:09:39.877062 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.virt.hardware [None req-f2d30649-1a5c-46b8-a79f-8d77d56ffa85 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 05:09:39.885531 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f2d30649-1a5c-46b8-a79f-8d77d56ffa85 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:09:39.885976 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f2d30649-1a5c-46b8-a79f-8d77d56ffa85 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:09:39.886782 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f2d30649-1a5c-46b8-a79f-8d77d56ffa85 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:09:39.887218 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f2d30649-1a5c-46b8-a79f-8d77d56ffa85 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:09:39.903395 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.quota [None req-f2d30649-1a5c-46b8-a79f-8d77d56ffa85 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Getting quotas for project 7a8063f2f6d64b79928f170fd6d99da8. Resources: {'ram', 'cores', 'instances'} {{(pid=107485) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 07 05:09:39.907863 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.quota [None req-f2d30649-1a5c-46b8-a79f-8d77d56ffa85 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Getting quotas for user 5472ec0a0ae74e9bbf00e2bcf5db21c4 and project 7a8063f2f6d64b79928f170fd6d99da8. Resources: {'ram', 'cores', 'instances'} {{(pid=107485) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 07 05:09:39.918383 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-f2d30649-1a5c-46b8-a79f-8d77d56ffa85 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Going to run 1 instances... {{(pid=107485) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 07 05:09:39.920710 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-f2d30649-1a5c-46b8-a79f-8d77d56ffa85 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ddcf95b5-3ea4-4a61-8f54-4b2feadb8682',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107485) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 07 05:09:39.967818 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-f2d30649-1a5c-46b8-a79f-8d77d56ffa85 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.546732 Aug 07 05:09:39.968463 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 646/1332] 10.222.0.35 () {60 vars in 1147 bytes} [Sat Aug 7 05:09:39 2021] POST /compute/v2.1/servers => generated 400 bytes in 548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 05:09:39.978838 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-a77d88f5-a3af-4e1f-b9cc-2c169286e05e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:09:39.980261 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-a77d88f5-a3af-4e1f-b9cc-2c169286e05e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:09:40.033849 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-a77d88f5-a3af-4e1f-b9cc-2c169286e05e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5472ec0a0ae74e9bbf00e2bcf5db21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8063f2f6d64b79928f170fd6d99da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:09:40.040219 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-a77d88f5-a3af-4e1f-b9cc-2c169286e05e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b" status: 200 len: 1237 microversion: 2.1 time: 0.065261 Aug 07 05:09:40.040875 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 687/1333] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:09:39 2021] GET /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b => generated 1237 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:09:41.058093 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-5f195d72-1109-4ebf-b15c-4a0e6de6ebd1 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:09:41.058970 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-5f195d72-1109-4ebf-b15c-4a0e6de6ebd1 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:09:41.066447 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5f195d72-1109-4ebf-b15c-4a0e6de6ebd1 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:09:41.066890 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5f195d72-1109-4ebf-b15c-4a0e6de6ebd1 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:09:41.067689 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5f195d72-1109-4ebf-b15c-4a0e6de6ebd1 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:09:41.068195 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5f195d72-1109-4ebf-b15c-4a0e6de6ebd1 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:09:41.145801 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-5f195d72-1109-4ebf-b15c-4a0e6de6ebd1 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5472ec0a0ae74e9bbf00e2bcf5db21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8063f2f6d64b79928f170fd6d99da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:09:41.152998 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-5f195d72-1109-4ebf-b15c-4a0e6de6ebd1 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b" status: 200 len: 1295 microversion: 2.1 time: 0.099366 Aug 07 05:09:41.153563 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 647/1334] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:09:41 2021] GET /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b => generated 1295 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:09:42.171181 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-da1464f5-6ec2-43cb-a7f5-915c64db71af tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:09:42.171803 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-da1464f5-6ec2-43cb-a7f5-915c64db71af tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:09:42.180547 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-da1464f5-6ec2-43cb-a7f5-915c64db71af tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:09:42.181337 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-da1464f5-6ec2-43cb-a7f5-915c64db71af tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:09:42.182601 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-da1464f5-6ec2-43cb-a7f5-915c64db71af tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:09:42.183334 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-da1464f5-6ec2-43cb-a7f5-915c64db71af tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:09:42.343116 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-da1464f5-6ec2-43cb-a7f5-915c64db71af tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5472ec0a0ae74e9bbf00e2bcf5db21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8063f2f6d64b79928f170fd6d99da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:09:42.352089 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-da1464f5-6ec2-43cb-a7f5-915c64db71af tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b" status: 200 len: 1361 microversion: 2.1 time: 0.184708 Aug 07 05:09:42.352662 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 688/1335] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:09:42 2021] GET /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b => generated 1361 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 05:09:42.439424 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [req-a844c3bd-0062-42a1-98ec-cfa9698d95aa req-14c70b11-f996-4bd8-8ef6-a424eb905144 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c6f88d1-221f-41c3-858c-362ff1d02f0b", "tag": "e2105386-6935-4bf2-8bcc-97388a21e95a"}]} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:09:42.449304 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 05:09:42.449304 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: warnings.warn(msg) Aug 07 05:09:42.465691 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-a844c3bd-0062-42a1-98ec-cfa9698d95aa req-14c70b11-f996-4bd8-8ef6-a424eb905144 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:09:42.469035 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-a844c3bd-0062-42a1-98ec-cfa9698d95aa req-14c70b11-f996-4bd8-8ef6-a424eb905144 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:09:42.482534 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.compute.server_external_events [req-a844c3bd-0062-42a1-98ec-cfa9698d95aa req-14c70b11-f996-4bd8-8ef6-a424eb905144 service nova] Creating event network-changed:e2105386-6935-4bf2-8bcc-97388a21e95a for instance 6c6f88d1-221f-41c3-858c-362ff1d02f0b on hv-cinder-80374 Aug 07 05:09:42.489170 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [req-a844c3bd-0062-42a1-98ec-cfa9698d95aa req-14c70b11-f996-4bd8-8ef6-a424eb905144 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055460 Aug 07 05:09:42.489770 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 648/1336] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 05:09:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 05:09:43.368510 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-2f14ff70-f394-4b3c-8338-480f17076a8a tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:09:43.369148 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-2f14ff70-f394-4b3c-8338-480f17076a8a tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:09:43.374879 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2f14ff70-f394-4b3c-8338-480f17076a8a tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:09:43.375361 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2f14ff70-f394-4b3c-8338-480f17076a8a tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:09:43.376128 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2f14ff70-f394-4b3c-8338-480f17076a8a tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:09:43.376674 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2f14ff70-f394-4b3c-8338-480f17076a8a tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:09:43.494969 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-2f14ff70-f394-4b3c-8338-480f17076a8a tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5472ec0a0ae74e9bbf00e2bcf5db21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8063f2f6d64b79928f170fd6d99da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:09:43.502126 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-2f14ff70-f394-4b3c-8338-480f17076a8a tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b" status: 200 len: 1361 microversion: 2.1 time: 0.137244 Aug 07 05:09:43.502676 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 689/1337] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:09:43 2021] GET /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b => generated 1361 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:09:44.519481 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-4d96ca72-91f7-4adf-827c-1cb3503f1b8b tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:09:44.520165 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-4d96ca72-91f7-4adf-827c-1cb3503f1b8b tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:09:44.526194 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4d96ca72-91f7-4adf-827c-1cb3503f1b8b tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:09:44.526632 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4d96ca72-91f7-4adf-827c-1cb3503f1b8b tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:09:44.527388 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4d96ca72-91f7-4adf-827c-1cb3503f1b8b tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:09:44.527823 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4d96ca72-91f7-4adf-827c-1cb3503f1b8b tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:09:44.647095 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-4d96ca72-91f7-4adf-827c-1cb3503f1b8b tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5472ec0a0ae74e9bbf00e2bcf5db21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8063f2f6d64b79928f170fd6d99da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:09:44.654218 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-4d96ca72-91f7-4adf-827c-1cb3503f1b8b tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b" status: 200 len: 1361 microversion: 2.1 time: 0.139263 Aug 07 05:09:44.654774 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 649/1338] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:09:44 2021] GET /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b => generated 1361 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:09:45.670827 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-9350ded3-aa84-409d-87ad-cb21a51b0ba1 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:09:45.671429 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-9350ded3-aa84-409d-87ad-cb21a51b0ba1 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:09:45.678001 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9350ded3-aa84-409d-87ad-cb21a51b0ba1 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:09:45.678440 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9350ded3-aa84-409d-87ad-cb21a51b0ba1 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:09:45.679194 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9350ded3-aa84-409d-87ad-cb21a51b0ba1 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:09:45.679622 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9350ded3-aa84-409d-87ad-cb21a51b0ba1 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:09:45.798780 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-9350ded3-aa84-409d-87ad-cb21a51b0ba1 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5472ec0a0ae74e9bbf00e2bcf5db21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8063f2f6d64b79928f170fd6d99da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:09:45.805962 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-9350ded3-aa84-409d-87ad-cb21a51b0ba1 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b" status: 200 len: 1361 microversion: 2.1 time: 0.138821 Aug 07 05:09:45.806514 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 690/1339] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:09:45 2021] GET /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b => generated 1361 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:09:46.821788 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-a6a99cd8-d02f-48c4-8675-0575385bb49c tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:09:46.822302 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-a6a99cd8-d02f-48c4-8675-0575385bb49c tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:09:46.828093 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a6a99cd8-d02f-48c4-8675-0575385bb49c tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:09:46.828529 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a6a99cd8-d02f-48c4-8675-0575385bb49c tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:09:46.829914 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a6a99cd8-d02f-48c4-8675-0575385bb49c tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:09:46.830344 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a6a99cd8-d02f-48c4-8675-0575385bb49c tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:09:46.946733 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-a6a99cd8-d02f-48c4-8675-0575385bb49c tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5472ec0a0ae74e9bbf00e2bcf5db21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8063f2f6d64b79928f170fd6d99da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:09:46.953907 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-a6a99cd8-d02f-48c4-8675-0575385bb49c tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b" status: 200 len: 1361 microversion: 2.1 time: 0.135770 Aug 07 05:09:46.955275 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 650/1340] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:09:46 2021] GET /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b => generated 1361 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:09:47.972032 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-f67064d3-4486-4ec9-9381-cfa4eaabd7c7 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:09:47.972587 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-f67064d3-4486-4ec9-9381-cfa4eaabd7c7 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:09:47.978452 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f67064d3-4486-4ec9-9381-cfa4eaabd7c7 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:09:47.978898 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f67064d3-4486-4ec9-9381-cfa4eaabd7c7 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:09:47.979664 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f67064d3-4486-4ec9-9381-cfa4eaabd7c7 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:09:47.980094 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f67064d3-4486-4ec9-9381-cfa4eaabd7c7 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:09:48.106169 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-f67064d3-4486-4ec9-9381-cfa4eaabd7c7 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5472ec0a0ae74e9bbf00e2bcf5db21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8063f2f6d64b79928f170fd6d99da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:09:48.114108 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-f67064d3-4486-4ec9-9381-cfa4eaabd7c7 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b" status: 200 len: 1361 microversion: 2.1 time: 0.146307 Aug 07 05:09:48.114676 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 691/1341] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:09:47 2021] GET /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b => generated 1361 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:09:48.647201 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [req-f13e25c4-b867-4ceb-83d3-f03c8f501307 req-ac86ffff-b56f-45bf-a71a-da745f6347fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c6f88d1-221f-41c3-858c-362ff1d02f0b", "name": "network-vif-plugged", "status": "completed", "tag": "e2105386-6935-4bf2-8bcc-97388a21e95a"}]} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:09:48.648832 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 05:09:48.648832 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: warnings.warn(msg) Aug 07 05:09:48.658189 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-f13e25c4-b867-4ceb-83d3-f03c8f501307 req-ac86ffff-b56f-45bf-a71a-da745f6347fc service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:09:48.658737 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-f13e25c4-b867-4ceb-83d3-f03c8f501307 req-ac86ffff-b56f-45bf-a71a-da745f6347fc service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:09:48.670098 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.compute.server_external_events [req-f13e25c4-b867-4ceb-83d3-f03c8f501307 req-ac86ffff-b56f-45bf-a71a-da745f6347fc service nova] Creating event network-vif-plugged:e2105386-6935-4bf2-8bcc-97388a21e95a for instance 6c6f88d1-221f-41c3-858c-362ff1d02f0b on hv-cinder-80374 Aug 07 05:09:48.675784 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [req-f13e25c4-b867-4ceb-83d3-f03c8f501307 req-ac86ffff-b56f-45bf-a71a-da745f6347fc service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032147 Aug 07 05:09:48.676358 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 651/1342] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 05:09:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 05:09:49.130778 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-70867756-5bb1-4799-85a0-3786b0fe4327 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:09:49.131322 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-70867756-5bb1-4799-85a0-3786b0fe4327 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:09:49.137187 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-70867756-5bb1-4799-85a0-3786b0fe4327 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:09:49.137631 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-70867756-5bb1-4799-85a0-3786b0fe4327 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:09:49.138387 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-70867756-5bb1-4799-85a0-3786b0fe4327 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:09:49.138817 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-70867756-5bb1-4799-85a0-3786b0fe4327 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:09:49.256343 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-70867756-5bb1-4799-85a0-3786b0fe4327 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5472ec0a0ae74e9bbf00e2bcf5db21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8063f2f6d64b79928f170fd6d99da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:09:49.263470 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-70867756-5bb1-4799-85a0-3786b0fe4327 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b" status: 200 len: 1361 microversion: 2.1 time: 0.136413 Aug 07 05:09:49.264037 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 692/1343] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:09:49 2021] GET /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b => generated 1361 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:09:50.281463 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-67764042-244e-460d-b7c1-47350c9bb42e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:09:50.283015 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-67764042-244e-460d-b7c1-47350c9bb42e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:09:50.289226 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-67764042-244e-460d-b7c1-47350c9bb42e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:09:50.289668 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-67764042-244e-460d-b7c1-47350c9bb42e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:09:50.290431 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-67764042-244e-460d-b7c1-47350c9bb42e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:09:50.290860 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-67764042-244e-460d-b7c1-47350c9bb42e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:09:50.411567 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-67764042-244e-460d-b7c1-47350c9bb42e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5472ec0a0ae74e9bbf00e2bcf5db21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8063f2f6d64b79928f170fd6d99da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:09:50.418740 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-67764042-244e-460d-b7c1-47350c9bb42e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b" status: 200 len: 1547 microversion: 2.1 time: 0.141291 Aug 07 05:09:50.419293 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 652/1344] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:09:50 2021] GET /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b => generated 1547 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:09:50.434438 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-d0bd5d68-505f-41b4-bf42-fd6e824add32 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:09:50.435031 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-d0bd5d68-505f-41b4-bf42-fd6e824add32 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:09:50.440840 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d0bd5d68-505f-41b4-bf42-fd6e824add32 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:09:50.441289 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d0bd5d68-505f-41b4-bf42-fd6e824add32 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:09:50.442054 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d0bd5d68-505f-41b4-bf42-fd6e824add32 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:09:50.442487 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d0bd5d68-505f-41b4-bf42-fd6e824add32 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:09:50.520728 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-d0bd5d68-505f-41b4-bf42-fd6e824add32 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089988 Aug 07 05:09:50.521356 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 693/1345] 10.222.0.35 () {58 vars in 1275 bytes} [Sat Aug 7 05:09:50 2021] GET /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 05:09:51.425305 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-a82b0f89-ca9d-44e1-8e73-fd6494855c14 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:09:51.426203 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-a82b0f89-ca9d-44e1-8e73-fd6494855c14 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:09:51.432307 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a82b0f89-ca9d-44e1-8e73-fd6494855c14 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:09:51.432754 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a82b0f89-ca9d-44e1-8e73-fd6494855c14 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:09:51.433546 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a82b0f89-ca9d-44e1-8e73-fd6494855c14 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:09:51.433977 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-a82b0f89-ca9d-44e1-8e73-fd6494855c14 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:09:51.491383 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [req-fc13a51a-c720-439a-b71a-abf14d11085f req-ac6b5fe8-b6e1-4be3-b723-87947228bf69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c6f88d1-221f-41c3-858c-362ff1d02f0b", "tag": "e2105386-6935-4bf2-8bcc-97388a21e95a"}]} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:09:51.493018 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 05:09:51.493018 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: warnings.warn(msg) Aug 07 05:09:51.499775 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-fc13a51a-c720-439a-b71a-abf14d11085f req-ac6b5fe8-b6e1-4be3-b723-87947228bf69 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:09:51.500221 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-fc13a51a-c720-439a-b71a-abf14d11085f req-ac6b5fe8-b6e1-4be3-b723-87947228bf69 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:09:51.512096 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.compute.server_external_events [req-fc13a51a-c720-439a-b71a-abf14d11085f req-ac6b5fe8-b6e1-4be3-b723-87947228bf69 service nova] Creating event network-changed:e2105386-6935-4bf2-8bcc-97388a21e95a for instance 6c6f88d1-221f-41c3-858c-362ff1d02f0b on hv-cinder-80374 Aug 07 05:09:51.515357 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-a82b0f89-ca9d-44e1-8e73-fd6494855c14 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 14 microversion: 2.1 time: 0.093534 Aug 07 05:09:51.516833 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 653/1346] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:09:51 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 05:09:51.518261 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [req-fc13a51a-c720-439a-b71a-abf14d11085f req-ac6b5fe8-b6e1-4be3-b723-87947228bf69 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093525 Aug 07 05:09:51.519205 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 694/1347] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 05:09:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 05:09:52.527871 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-f3fd0375-93dc-41c4-87dc-e2b1ecd79f8e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:09:52.528822 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-f3fd0375-93dc-41c4-87dc-e2b1ecd79f8e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:09:52.535872 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f3fd0375-93dc-41c4-87dc-e2b1ecd79f8e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:09:52.536321 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f3fd0375-93dc-41c4-87dc-e2b1ecd79f8e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:09:52.537138 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f3fd0375-93dc-41c4-87dc-e2b1ecd79f8e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:09:52.537574 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f3fd0375-93dc-41c4-87dc-e2b1ecd79f8e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:09:52.619178 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-f3fd0375-93dc-41c4-87dc-e2b1ecd79f8e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 14 microversion: 2.1 time: 0.095218 Aug 07 05:09:52.619835 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 654/1348] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:09:52 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 05:09:53.630718 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-32bf008f-fb30-4da9-9c98-8aed19a4b5af tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:09:53.631711 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-32bf008f-fb30-4da9-9c98-8aed19a4b5af tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:09:53.638003 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-32bf008f-fb30-4da9-9c98-8aed19a4b5af tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:09:53.638446 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-32bf008f-fb30-4da9-9c98-8aed19a4b5af tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:09:53.639209 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-32bf008f-fb30-4da9-9c98-8aed19a4b5af tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:09:53.639640 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-32bf008f-fb30-4da9-9c98-8aed19a4b5af tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:09:53.721472 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-32bf008f-fb30-4da9-9c98-8aed19a4b5af tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 14 microversion: 2.1 time: 0.094697 Aug 07 05:09:53.722012 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 695/1349] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:09:53 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 05:09:54.732344 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-b1e5009a-d2c3-4352-ae77-388ff23878ca tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:09:54.733353 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-b1e5009a-d2c3-4352-ae77-388ff23878ca tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:09:54.740433 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b1e5009a-d2c3-4352-ae77-388ff23878ca tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:09:54.740903 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b1e5009a-d2c3-4352-ae77-388ff23878ca tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:09:54.741668 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b1e5009a-d2c3-4352-ae77-388ff23878ca tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:09:54.742095 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b1e5009a-d2c3-4352-ae77-388ff23878ca tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:09:54.819875 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-b1e5009a-d2c3-4352-ae77-388ff23878ca tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 14 microversion: 2.1 time: 0.091456 Aug 07 05:09:54.820506 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 655/1350] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:09:54 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 05:09:55.830943 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-e5989216-62e0-4aaa-a138-fafa3bf36556 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:09:55.832190 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-e5989216-62e0-4aaa-a138-fafa3bf36556 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:09:55.838579 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e5989216-62e0-4aaa-a138-fafa3bf36556 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:09:55.839017 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e5989216-62e0-4aaa-a138-fafa3bf36556 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:09:55.839769 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e5989216-62e0-4aaa-a138-fafa3bf36556 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:09:55.840199 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e5989216-62e0-4aaa-a138-fafa3bf36556 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:09:55.936596 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-e5989216-62e0-4aaa-a138-fafa3bf36556 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 14 microversion: 2.1 time: 0.109516 Aug 07 05:09:55.937159 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 696/1351] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:09:55 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 05:09:56.948231 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-d9de4df8-eaa4-48a4-b539-6cebac1139f8 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:09:56.949199 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-d9de4df8-eaa4-48a4-b539-6cebac1139f8 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:09:56.956140 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d9de4df8-eaa4-48a4-b539-6cebac1139f8 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:09:56.956612 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d9de4df8-eaa4-48a4-b539-6cebac1139f8 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:09:56.957666 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d9de4df8-eaa4-48a4-b539-6cebac1139f8 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:09:56.958100 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d9de4df8-eaa4-48a4-b539-6cebac1139f8 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:09:57.037741 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-d9de4df8-eaa4-48a4-b539-6cebac1139f8 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 14 microversion: 2.1 time: 0.093508 Aug 07 05:09:57.039649 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 656/1352] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:09:56 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 05:09:58.050001 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-562471f2-fa77-41c8-a7a0-71125c0437ce tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:09:58.050929 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-562471f2-fa77-41c8-a7a0-71125c0437ce tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:09:58.057375 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-562471f2-fa77-41c8-a7a0-71125c0437ce tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:09:58.057816 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-562471f2-fa77-41c8-a7a0-71125c0437ce tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:09:58.058571 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-562471f2-fa77-41c8-a7a0-71125c0437ce tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:09:58.058996 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-562471f2-fa77-41c8-a7a0-71125c0437ce tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:09:58.136418 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-562471f2-fa77-41c8-a7a0-71125c0437ce tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 14 microversion: 2.1 time: 0.091008 Aug 07 05:09:58.137031 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 697/1353] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:09:58 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 07 05:09:59.148904 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-2418090c-56cd-42cb-a95e-bbcd7d95da8f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:09:59.149888 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-2418090c-56cd-42cb-a95e-bbcd7d95da8f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:09:59.156164 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2418090c-56cd-42cb-a95e-bbcd7d95da8f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:09:59.157137 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2418090c-56cd-42cb-a95e-bbcd7d95da8f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:09:59.158044 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2418090c-56cd-42cb-a95e-bbcd7d95da8f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:09:59.158473 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2418090c-56cd-42cb-a95e-bbcd7d95da8f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:09:59.239466 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-2418090c-56cd-42cb-a95e-bbcd7d95da8f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 14 microversion: 2.1 time: 0.094363 Aug 07 05:09:59.240106 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 657/1354] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:09:59 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 05:10:00.251939 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-97a6f5b0-d0a9-462b-9b8e-64d0971eff93 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:10:00.253022 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-97a6f5b0-d0a9-462b-9b8e-64d0971eff93 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:10:00.259533 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-97a6f5b0-d0a9-462b-9b8e-64d0971eff93 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:00.259980 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-97a6f5b0-d0a9-462b-9b8e-64d0971eff93 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:00.260744 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-97a6f5b0-d0a9-462b-9b8e-64d0971eff93 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:00.261204 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-97a6f5b0-d0a9-462b-9b8e-64d0971eff93 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:00.338966 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-97a6f5b0-d0a9-462b-9b8e-64d0971eff93 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 14 microversion: 2.1 time: 0.092079 Aug 07 05:10:00.339563 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 698/1355] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:10:00 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 05:10:01.350155 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-e5755c28-51d7-46d9-806b-a3ca10f78eea tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:10:01.351149 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-e5755c28-51d7-46d9-806b-a3ca10f78eea tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:10:01.357638 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e5755c28-51d7-46d9-806b-a3ca10f78eea tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:01.358088 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e5755c28-51d7-46d9-806b-a3ca10f78eea tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:01.358850 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e5755c28-51d7-46d9-806b-a3ca10f78eea tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:01.359281 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e5755c28-51d7-46d9-806b-a3ca10f78eea tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:01.441735 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-e5755c28-51d7-46d9-806b-a3ca10f78eea tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 14 microversion: 2.1 time: 0.095506 Aug 07 05:10:01.442333 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 658/1356] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:10:01 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 05:10:02.453062 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-d48f591b-0143-4127-a744-1e0b7f6c9f03 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:10:02.454963 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-d48f591b-0143-4127-a744-1e0b7f6c9f03 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:10:02.461704 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d48f591b-0143-4127-a744-1e0b7f6c9f03 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:02.462152 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d48f591b-0143-4127-a744-1e0b7f6c9f03 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:02.462914 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d48f591b-0143-4127-a744-1e0b7f6c9f03 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:02.463348 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d48f591b-0143-4127-a744-1e0b7f6c9f03 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:02.549601 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-d48f591b-0143-4127-a744-1e0b7f6c9f03 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 10009 microversion: 2.1 time: 0.100513 Aug 07 05:10:02.550196 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 699/1357] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:10:02 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 10009 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:10:03.561158 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-4f042e45-b860-4424-83c1-661d89f4783f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:10:03.562130 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-4f042e45-b860-4424-83c1-661d89f4783f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:10:03.569745 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4f042e45-b860-4424-83c1-661d89f4783f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:03.570253 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4f042e45-b860-4424-83c1-661d89f4783f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:03.571014 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4f042e45-b860-4424-83c1-661d89f4783f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:03.571438 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4f042e45-b860-4424-83c1-661d89f4783f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:03.667029 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-4f042e45-b860-4424-83c1-661d89f4783f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 17250 microversion: 2.1 time: 0.109556 Aug 07 05:10:03.667665 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 659/1358] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:10:03 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 17250 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:10:04.679046 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-18c342f6-72ea-485e-87ac-98cdd4a185bc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:10:04.680042 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-18c342f6-72ea-485e-87ac-98cdd4a185bc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:10:04.686728 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-18c342f6-72ea-485e-87ac-98cdd4a185bc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:04.687180 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-18c342f6-72ea-485e-87ac-98cdd4a185bc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:04.688152 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-18c342f6-72ea-485e-87ac-98cdd4a185bc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:04.688590 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-18c342f6-72ea-485e-87ac-98cdd4a185bc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:04.798451 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-18c342f6-72ea-485e-87ac-98cdd4a185bc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 19096 microversion: 2.1 time: 0.123235 Aug 07 05:10:04.799254 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 700/1359] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:10:04 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 19096 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:10:05.810287 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-ee9c658d-2edb-4b48-a2df-d0ad24a21d37 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:10:05.811278 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-ee9c658d-2edb-4b48-a2df-d0ad24a21d37 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:10:05.818297 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ee9c658d-2edb-4b48-a2df-d0ad24a21d37 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:05.818739 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ee9c658d-2edb-4b48-a2df-d0ad24a21d37 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:05.819500 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ee9c658d-2edb-4b48-a2df-d0ad24a21d37 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:05.819930 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ee9c658d-2edb-4b48-a2df-d0ad24a21d37 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:05.909331 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-ee9c658d-2edb-4b48-a2df-d0ad24a21d37 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 21519 microversion: 2.1 time: 0.102874 Aug 07 05:10:05.909864 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 660/1360] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:10:05 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 21519 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:10:06.921144 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-f82e6c7f-eaf4-4b94-b324-0314fb1926cc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:10:06.922693 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-f82e6c7f-eaf4-4b94-b324-0314fb1926cc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:10:06.929190 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f82e6c7f-eaf4-4b94-b324-0314fb1926cc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:06.929643 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f82e6c7f-eaf4-4b94-b324-0314fb1926cc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:06.930417 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f82e6c7f-eaf4-4b94-b324-0314fb1926cc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:06.930848 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f82e6c7f-eaf4-4b94-b324-0314fb1926cc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:07.025738 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-f82e6c7f-eaf4-4b94-b324-0314fb1926cc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 23228 microversion: 2.1 time: 0.108416 Aug 07 05:10:07.026902 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 701/1361] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:10:06 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 23228 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:10:08.038077 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-7ff32573-52c6-4c77-9b7c-28072f99cd55 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:10:08.038982 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-7ff32573-52c6-4c77-9b7c-28072f99cd55 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:10:08.045399 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7ff32573-52c6-4c77-9b7c-28072f99cd55 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:08.045840 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7ff32573-52c6-4c77-9b7c-28072f99cd55 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:08.046597 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7ff32573-52c6-4c77-9b7c-28072f99cd55 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:08.047679 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7ff32573-52c6-4c77-9b7c-28072f99cd55 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:08.134505 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-7ff32573-52c6-4c77-9b7c-28072f99cd55 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 24767 microversion: 2.1 time: 0.100405 Aug 07 05:10:08.135117 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 661/1362] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:10:08 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 24767 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:10:09.147060 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-63d98fdc-996f-4223-b61d-511a473b11ee tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:10:09.148063 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-63d98fdc-996f-4223-b61d-511a473b11ee tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:10:09.154609 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-63d98fdc-996f-4223-b61d-511a473b11ee tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:09.155057 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-63d98fdc-996f-4223-b61d-511a473b11ee tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:09.155828 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-63d98fdc-996f-4223-b61d-511a473b11ee tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:09.156949 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-63d98fdc-996f-4223-b61d-511a473b11ee tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:09.250155 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-63d98fdc-996f-4223-b61d-511a473b11ee tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 26363 microversion: 2.1 time: 0.107017 Aug 07 05:10:09.250772 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 702/1363] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:10:09 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 26363 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:10:10.261997 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-f61cbb7b-fccb-4e41-82c7-2fccd58f8db7 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:10:10.263006 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-f61cbb7b-fccb-4e41-82c7-2fccd58f8db7 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:10:10.270271 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f61cbb7b-fccb-4e41-82c7-2fccd58f8db7 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:10.270714 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f61cbb7b-fccb-4e41-82c7-2fccd58f8db7 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:10.271476 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f61cbb7b-fccb-4e41-82c7-2fccd58f8db7 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:10.271904 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f61cbb7b-fccb-4e41-82c7-2fccd58f8db7 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:10.366845 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-f61cbb7b-fccb-4e41-82c7-2fccd58f8db7 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 27554 microversion: 2.1 time: 0.108713 Aug 07 05:10:10.367461 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 662/1364] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:10:10 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 27554 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:10:11.430735 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-e312584f-bfaf-409c-bf8f-099773979c29 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:10:11.431771 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-e312584f-bfaf-409c-bf8f-099773979c29 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:10:11.438358 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e312584f-bfaf-409c-bf8f-099773979c29 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:11.438857 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e312584f-bfaf-409c-bf8f-099773979c29 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:11.439647 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e312584f-bfaf-409c-bf8f-099773979c29 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:11.440075 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e312584f-bfaf-409c-bf8f-099773979c29 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:11.530919 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-e312584f-bfaf-409c-bf8f-099773979c29 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 27967 microversion: 2.1 time: 0.156066 Aug 07 05:10:11.532201 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 703/1365] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:10:11 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 27967 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:10:12.543756 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-8f4f5e54-769f-4695-abb2-4495a0e53770 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:10:12.544761 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-8f4f5e54-769f-4695-abb2-4495a0e53770 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:10:12.551808 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8f4f5e54-769f-4695-abb2-4495a0e53770 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:12.552249 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8f4f5e54-769f-4695-abb2-4495a0e53770 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:12.553031 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8f4f5e54-769f-4695-abb2-4495a0e53770 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:12.553462 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8f4f5e54-769f-4695-abb2-4495a0e53770 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:12.650175 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-8f4f5e54-769f-4695-abb2-4495a0e53770 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 28204 microversion: 2.1 time: 0.110300 Aug 07 05:10:12.650816 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 663/1366] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:10:12 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 28204 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:10:13.662390 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-223d4989-e57e-46c1-92ea-b7d8032e10b9 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:10:13.663410 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-223d4989-e57e-46c1-92ea-b7d8032e10b9 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:10:13.669858 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-223d4989-e57e-46c1-92ea-b7d8032e10b9 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:13.670301 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-223d4989-e57e-46c1-92ea-b7d8032e10b9 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:13.671052 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-223d4989-e57e-46c1-92ea-b7d8032e10b9 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:13.671480 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-223d4989-e57e-46c1-92ea-b7d8032e10b9 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:13.753104 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-223d4989-e57e-46c1-92ea-b7d8032e10b9 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 28204 microversion: 2.1 time: 0.094499 Aug 07 05:10:13.754630 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 704/1367] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:10:13 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 28204 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:10:14.765567 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-e18f7e0d-caaf-41c5-973f-f5a3e4513822 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:10:14.766805 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-e18f7e0d-caaf-41c5-973f-f5a3e4513822 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:10:14.773245 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e18f7e0d-caaf-41c5-973f-f5a3e4513822 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:14.773694 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e18f7e0d-caaf-41c5-973f-f5a3e4513822 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:14.774461 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e18f7e0d-caaf-41c5-973f-f5a3e4513822 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:14.774901 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-e18f7e0d-caaf-41c5-973f-f5a3e4513822 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:14.860886 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-e18f7e0d-caaf-41c5-973f-f5a3e4513822 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 28204 microversion: 2.1 time: 0.099197 Aug 07 05:10:14.861499 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 664/1368] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:10:14 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 28204 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:10:15.873126 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-4ec10478-67c7-457d-94fd-59344c5f9b48 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:10:15.874054 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-4ec10478-67c7-457d-94fd-59344c5f9b48 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:10:15.880582 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4ec10478-67c7-457d-94fd-59344c5f9b48 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:15.881062 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4ec10478-67c7-457d-94fd-59344c5f9b48 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:15.881830 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4ec10478-67c7-457d-94fd-59344c5f9b48 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:15.882264 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4ec10478-67c7-457d-94fd-59344c5f9b48 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:15.964129 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-4ec10478-67c7-457d-94fd-59344c5f9b48 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 28204 microversion: 2.1 time: 0.095058 Aug 07 05:10:15.964733 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 705/1369] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:10:15 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 28204 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:10:16.976433 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-3644b1f5-3e40-4ae8-b406-a9049e820097 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:10:16.977793 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-3644b1f5-3e40-4ae8-b406-a9049e820097 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:10:16.984226 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3644b1f5-3e40-4ae8-b406-a9049e820097 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:16.985215 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3644b1f5-3e40-4ae8-b406-a9049e820097 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:16.986137 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3644b1f5-3e40-4ae8-b406-a9049e820097 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:16.986567 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-3644b1f5-3e40-4ae8-b406-a9049e820097 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:17.074263 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-3644b1f5-3e40-4ae8-b406-a9049e820097 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 28204 microversion: 2.1 time: 0.101524 Aug 07 05:10:17.074567 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 665/1370] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:10:16 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 28204 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:10:18.086198 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-0928442c-2405-4ac5-98e4-f3f0fff13709 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:10:18.087191 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-0928442c-2405-4ac5-98e4-f3f0fff13709 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:10:18.094578 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0928442c-2405-4ac5-98e4-f3f0fff13709 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:18.095082 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0928442c-2405-4ac5-98e4-f3f0fff13709 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:18.095845 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0928442c-2405-4ac5-98e4-f3f0fff13709 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:18.096284 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-0928442c-2405-4ac5-98e4-f3f0fff13709 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:18.182044 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-0928442c-2405-4ac5-98e4-f3f0fff13709 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 28204 microversion: 2.1 time: 0.100042 Aug 07 05:10:18.182651 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 706/1371] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:10:18 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 28204 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:10:19.194759 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-26d04a91-cce7-45c5-ab2c-4e2d0fcb0600 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:10:19.195741 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-26d04a91-cce7-45c5-ab2c-4e2d0fcb0600 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:10:19.202291 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-26d04a91-cce7-45c5-ab2c-4e2d0fcb0600 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:19.202735 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-26d04a91-cce7-45c5-ab2c-4e2d0fcb0600 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:19.204619 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-26d04a91-cce7-45c5-ab2c-4e2d0fcb0600 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:19.205087 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-26d04a91-cce7-45c5-ab2c-4e2d0fcb0600 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:19.289070 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-26d04a91-cce7-45c5-ab2c-4e2d0fcb0600 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 28204 microversion: 2.1 time: 0.098141 Aug 07 05:10:19.289682 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 666/1372] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:10:19 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 28204 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:10:20.301905 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-dc8f4eec-3d42-401f-914d-dfe11ddbd32f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:10:20.302909 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-dc8f4eec-3d42-401f-914d-dfe11ddbd32f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:10:20.309425 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-dc8f4eec-3d42-401f-914d-dfe11ddbd32f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:20.309868 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-dc8f4eec-3d42-401f-914d-dfe11ddbd32f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:20.310640 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-dc8f4eec-3d42-401f-914d-dfe11ddbd32f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:20.311072 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-dc8f4eec-3d42-401f-914d-dfe11ddbd32f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:20.393541 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-dc8f4eec-3d42-401f-914d-dfe11ddbd32f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 28204 microversion: 2.1 time: 0.096184 Aug 07 05:10:20.394150 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 707/1373] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:10:20 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 28204 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:10:21.405493 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-f7e37f2b-b5e5-46ee-abb8-c27913f6aa89 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:10:21.407209 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-f7e37f2b-b5e5-46ee-abb8-c27913f6aa89 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:10:21.413740 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f7e37f2b-b5e5-46ee-abb8-c27913f6aa89 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:21.414192 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f7e37f2b-b5e5-46ee-abb8-c27913f6aa89 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:21.414966 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f7e37f2b-b5e5-46ee-abb8-c27913f6aa89 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:21.415399 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f7e37f2b-b5e5-46ee-abb8-c27913f6aa89 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:21.500678 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-f7e37f2b-b5e5-46ee-abb8-c27913f6aa89 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 28204 microversion: 2.1 time: 0.099068 Aug 07 05:10:21.501386 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 667/1374] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:10:21 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 28204 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:10:22.512862 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-4afcdd7a-80ce-4829-a920-584eda618e0f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:10:22.513849 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-4afcdd7a-80ce-4829-a920-584eda618e0f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:10:22.521250 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4afcdd7a-80ce-4829-a920-584eda618e0f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:22.521695 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4afcdd7a-80ce-4829-a920-584eda618e0f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:22.522463 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4afcdd7a-80ce-4829-a920-584eda618e0f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:22.522895 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4afcdd7a-80ce-4829-a920-584eda618e0f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:22.604927 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-4afcdd7a-80ce-4829-a920-584eda618e0f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 28204 microversion: 2.1 time: 0.096020 Aug 07 05:10:22.605581 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 708/1375] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:10:22 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 28204 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:10:23.617990 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-6b0ce13a-f94c-4de0-8653-dcdc687e8c92 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:10:23.618983 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-6b0ce13a-f94c-4de0-8653-dcdc687e8c92 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:10:23.625534 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6b0ce13a-f94c-4de0-8653-dcdc687e8c92 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:23.625978 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6b0ce13a-f94c-4de0-8653-dcdc687e8c92 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:23.626746 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6b0ce13a-f94c-4de0-8653-dcdc687e8c92 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:23.627182 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-6b0ce13a-f94c-4de0-8653-dcdc687e8c92 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:23.716413 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-6b0ce13a-f94c-4de0-8653-dcdc687e8c92 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 28204 microversion: 2.1 time: 0.101982 Aug 07 05:10:23.717199 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 668/1376] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:10:23 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 28204 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:10:24.729031 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-cc30ab62-4d95-4763-b25f-8f9228cf07c6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:10:24.730047 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-cc30ab62-4d95-4763-b25f-8f9228cf07c6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:10:24.737266 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-cc30ab62-4d95-4763-b25f-8f9228cf07c6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:24.737702 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-cc30ab62-4d95-4763-b25f-8f9228cf07c6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:24.738460 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-cc30ab62-4d95-4763-b25f-8f9228cf07c6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:24.738874 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-cc30ab62-4d95-4763-b25f-8f9228cf07c6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:24.848490 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-cc30ab62-4d95-4763-b25f-8f9228cf07c6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 28495 microversion: 2.1 time: 0.123307 Aug 07 05:10:24.849221 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 709/1377] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:10:24 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 28495 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:10:25.860888 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-27ab615b-4841-448b-b466-c642ba4843d3 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:10:25.861911 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-27ab615b-4841-448b-b466-c642ba4843d3 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:10:25.868395 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-27ab615b-4841-448b-b466-c642ba4843d3 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:25.868813 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-27ab615b-4841-448b-b466-c642ba4843d3 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:25.869581 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-27ab615b-4841-448b-b466-c642ba4843d3 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:25.870013 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-27ab615b-4841-448b-b466-c642ba4843d3 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:25.949679 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-27ab615b-4841-448b-b466-c642ba4843d3 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 28495 microversion: 2.1 time: 0.093671 Aug 07 05:10:25.950296 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 669/1378] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:10:25 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 28495 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:10:26.962025 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-4a489517-2b5d-4bc8-89c8-7b2545e2d201 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:10:26.962931 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-4a489517-2b5d-4bc8-89c8-7b2545e2d201 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:10:26.969379 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4a489517-2b5d-4bc8-89c8-7b2545e2d201 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:26.969820 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4a489517-2b5d-4bc8-89c8-7b2545e2d201 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:26.970574 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4a489517-2b5d-4bc8-89c8-7b2545e2d201 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:26.971000 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4a489517-2b5d-4bc8-89c8-7b2545e2d201 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:27.064132 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-4a489517-2b5d-4bc8-89c8-7b2545e2d201 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 28663 microversion: 2.1 time: 0.106018 Aug 07 05:10:27.065046 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 710/1379] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:10:26 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 28663 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:10:28.076195 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-4f5bfca5-b083-4762-b0f5-c9e7bd2bae9e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:10:28.077136 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-4f5bfca5-b083-4762-b0f5-c9e7bd2bae9e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:10:28.084389 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4f5bfca5-b083-4762-b0f5-c9e7bd2bae9e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:28.084861 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4f5bfca5-b083-4762-b0f5-c9e7bd2bae9e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:28.085631 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4f5bfca5-b083-4762-b0f5-c9e7bd2bae9e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:28.086065 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4f5bfca5-b083-4762-b0f5-c9e7bd2bae9e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:28.168696 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-4f5bfca5-b083-4762-b0f5-c9e7bd2bae9e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 28663 microversion: 2.1 time: 0.096505 Aug 07 05:10:28.169353 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 670/1380] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:10:28 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 28663 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:10:29.180609 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-aa7ec8a8-62a2-4e3a-b479-918304606c0b tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:10:29.181623 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-aa7ec8a8-62a2-4e3a-b479-918304606c0b tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:10:29.188097 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-aa7ec8a8-62a2-4e3a-b479-918304606c0b tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:29.188536 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-aa7ec8a8-62a2-4e3a-b479-918304606c0b tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:29.189323 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-aa7ec8a8-62a2-4e3a-b479-918304606c0b tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:29.189749 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-aa7ec8a8-62a2-4e3a-b479-918304606c0b tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:29.273715 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-aa7ec8a8-62a2-4e3a-b479-918304606c0b tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 28663 microversion: 2.1 time: 0.096999 Aug 07 05:10:29.274330 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 711/1381] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:10:29 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 28663 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:10:30.286067 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-1bb50c8f-40da-4d47-9642-f7276200c463 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:10:30.287068 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-1bb50c8f-40da-4d47-9642-f7276200c463 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:10:30.293525 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1bb50c8f-40da-4d47-9642-f7276200c463 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:30.293976 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1bb50c8f-40da-4d47-9642-f7276200c463 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:30.294741 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1bb50c8f-40da-4d47-9642-f7276200c463 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:30.295182 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1bb50c8f-40da-4d47-9642-f7276200c463 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:30.373457 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-1bb50c8f-40da-4d47-9642-f7276200c463 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 28663 microversion: 2.1 time: 0.091305 Aug 07 05:10:30.374074 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 671/1382] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:10:30 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 28663 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:10:31.385378 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-29acba20-cb54-4eb1-9806-1ffe97a67c22 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:10:31.386299 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-29acba20-cb54-4eb1-9806-1ffe97a67c22 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:10:31.392872 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-29acba20-cb54-4eb1-9806-1ffe97a67c22 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:31.393314 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-29acba20-cb54-4eb1-9806-1ffe97a67c22 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:31.394069 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-29acba20-cb54-4eb1-9806-1ffe97a67c22 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:31.394493 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-29acba20-cb54-4eb1-9806-1ffe97a67c22 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:31.476281 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-29acba20-cb54-4eb1-9806-1ffe97a67c22 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 28663 microversion: 2.1 time: 0.094809 Aug 07 05:10:31.476932 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 712/1383] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:10:31 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 28663 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:10:32.489735 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-dcbc975d-7b34-49c2-a7e7-1388a5eece51 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:10:32.490716 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-dcbc975d-7b34-49c2-a7e7-1388a5eece51 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:10:32.497147 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-dcbc975d-7b34-49c2-a7e7-1388a5eece51 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:32.497587 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-dcbc975d-7b34-49c2-a7e7-1388a5eece51 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:32.498339 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-dcbc975d-7b34-49c2-a7e7-1388a5eece51 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:32.498765 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-dcbc975d-7b34-49c2-a7e7-1388a5eece51 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:32.582248 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-dcbc975d-7b34-49c2-a7e7-1388a5eece51 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 28663 microversion: 2.1 time: 0.097628 Aug 07 05:10:32.583152 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 672/1384] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:10:32 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 28663 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:10:33.595106 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-625fe14d-e28f-4fb9-b945-44bf67f879e2 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:10:33.596098 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-625fe14d-e28f-4fb9-b945-44bf67f879e2 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:10:33.602723 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-625fe14d-e28f-4fb9-b945-44bf67f879e2 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:33.603169 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-625fe14d-e28f-4fb9-b945-44bf67f879e2 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:33.603929 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-625fe14d-e28f-4fb9-b945-44bf67f879e2 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:33.604357 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-625fe14d-e28f-4fb9-b945-44bf67f879e2 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:33.698386 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-625fe14d-e28f-4fb9-b945-44bf67f879e2 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 28663 microversion: 2.1 time: 0.107974 Aug 07 05:10:33.699043 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 713/1385] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:10:33 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 28663 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:10:34.711116 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-ead2037e-9578-4272-bd37-63f1bee0ba4f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:10:34.712166 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-ead2037e-9578-4272-bd37-63f1bee0ba4f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:10:34.719303 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ead2037e-9578-4272-bd37-63f1bee0ba4f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:34.719706 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ead2037e-9578-4272-bd37-63f1bee0ba4f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:34.720472 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ead2037e-9578-4272-bd37-63f1bee0ba4f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:34.720940 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-ead2037e-9578-4272-bd37-63f1bee0ba4f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:34.801549 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-ead2037e-9578-4272-bd37-63f1bee0ba4f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 28663 microversion: 2.1 time: 0.094563 Aug 07 05:10:34.802459 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 673/1386] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:10:34 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 28663 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:10:35.813560 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-67f91170-885b-44f2-b2b6-140a50ae06cc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:10:35.814543 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-67f91170-885b-44f2-b2b6-140a50ae06cc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:10:35.821029 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-67f91170-885b-44f2-b2b6-140a50ae06cc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:35.821478 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-67f91170-885b-44f2-b2b6-140a50ae06cc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:35.822237 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-67f91170-885b-44f2-b2b6-140a50ae06cc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:35.822670 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-67f91170-885b-44f2-b2b6-140a50ae06cc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:35.902707 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-67f91170-885b-44f2-b2b6-140a50ae06cc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 28663 microversion: 2.1 time: 0.093005 Aug 07 05:10:35.903491 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 714/1387] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:10:35 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 28663 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:10:36.915765 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-9a217228-865c-42cd-8515-d19449177184 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:10:36.916683 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-9a217228-865c-42cd-8515-d19449177184 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:10:36.923437 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9a217228-865c-42cd-8515-d19449177184 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:36.923882 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9a217228-865c-42cd-8515-d19449177184 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:36.924648 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9a217228-865c-42cd-8515-d19449177184 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:36.925112 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9a217228-865c-42cd-8515-d19449177184 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:37.007279 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-9a217228-865c-42cd-8515-d19449177184 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 28663 microversion: 2.1 time: 0.095474 Aug 07 05:10:37.008133 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 674/1388] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:10:36 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 28663 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:10:38.020698 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-9c594510-5be3-4ce7-9fd9-32e141b01065 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:10:38.021664 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-9c594510-5be3-4ce7-9fd9-32e141b01065 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:10:38.028084 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9c594510-5be3-4ce7-9fd9-32e141b01065 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:38.028531 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9c594510-5be3-4ce7-9fd9-32e141b01065 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:38.029322 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9c594510-5be3-4ce7-9fd9-32e141b01065 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:38.029757 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-9c594510-5be3-4ce7-9fd9-32e141b01065 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:38.114963 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-9c594510-5be3-4ce7-9fd9-32e141b01065 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 28663 microversion: 2.1 time: 0.098248 Aug 07 05:10:38.115828 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 715/1389] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:10:38 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 28663 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:10:39.127745 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-7c5a6ce6-e94b-4558-88d6-f7cc663814e3 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:10:39.128734 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-7c5a6ce6-e94b-4558-88d6-f7cc663814e3 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:10:39.135367 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7c5a6ce6-e94b-4558-88d6-f7cc663814e3 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:39.135818 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7c5a6ce6-e94b-4558-88d6-f7cc663814e3 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:39.136591 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7c5a6ce6-e94b-4558-88d6-f7cc663814e3 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:39.137049 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7c5a6ce6-e94b-4558-88d6-f7cc663814e3 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:39.217626 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-7c5a6ce6-e94b-4558-88d6-f7cc663814e3 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 28663 microversion: 2.1 time: 0.094499 Aug 07 05:10:39.218312 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 675/1390] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:10:39 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 28663 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:10:40.231009 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-8fbe5429-1449-4d0a-a2e2-505effc5bfc6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:10:40.232043 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-8fbe5429-1449-4d0a-a2e2-505effc5bfc6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:10:40.239086 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8fbe5429-1449-4d0a-a2e2-505effc5bfc6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:40.239525 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8fbe5429-1449-4d0a-a2e2-505effc5bfc6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:40.240296 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8fbe5429-1449-4d0a-a2e2-505effc5bfc6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:40.240728 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8fbe5429-1449-4d0a-a2e2-505effc5bfc6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:40.332170 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-8fbe5429-1449-4d0a-a2e2-505effc5bfc6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 28663 microversion: 2.1 time: 0.105531 Aug 07 05:10:40.332798 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 716/1391] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:10:40 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 28663 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:10:41.345034 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-54cf4f0e-756d-4501-b17a-4ef2e2ba8fd4 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:10:41.345995 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-54cf4f0e-756d-4501-b17a-4ef2e2ba8fd4 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:10:41.352423 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-54cf4f0e-756d-4501-b17a-4ef2e2ba8fd4 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:41.352916 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-54cf4f0e-756d-4501-b17a-4ef2e2ba8fd4 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:41.353687 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-54cf4f0e-756d-4501-b17a-4ef2e2ba8fd4 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:41.354123 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-54cf4f0e-756d-4501-b17a-4ef2e2ba8fd4 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:41.439744 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-54cf4f0e-756d-4501-b17a-4ef2e2ba8fd4 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 28663 microversion: 2.1 time: 0.099568 Aug 07 05:10:41.440353 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 676/1392] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:10:41 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 28663 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:10:42.451430 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-63c07051-22f7-4595-850b-6e53f411ccd1 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:10:42.452643 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-63c07051-22f7-4595-850b-6e53f411ccd1 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:10:42.459437 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-63c07051-22f7-4595-850b-6e53f411ccd1 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:42.459876 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-63c07051-22f7-4595-850b-6e53f411ccd1 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:42.460631 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-63c07051-22f7-4595-850b-6e53f411ccd1 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:42.461086 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-63c07051-22f7-4595-850b-6e53f411ccd1 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:42.541635 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-63c07051-22f7-4595-850b-6e53f411ccd1 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 28663 microversion: 2.1 time: 0.094168 Aug 07 05:10:42.542242 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 717/1393] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:10:42 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 28663 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:10:43.555775 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-5131a501-c80b-47fd-876d-a58e070f0c20 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:10:43.557084 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-5131a501-c80b-47fd-876d-a58e070f0c20 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:10:43.564593 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5131a501-c80b-47fd-876d-a58e070f0c20 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:43.565064 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5131a501-c80b-47fd-876d-a58e070f0c20 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:43.565845 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5131a501-c80b-47fd-876d-a58e070f0c20 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:43.566283 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5131a501-c80b-47fd-876d-a58e070f0c20 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:43.649036 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-5131a501-c80b-47fd-876d-a58e070f0c20 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 28663 microversion: 2.1 time: 0.098753 Aug 07 05:10:43.649687 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 677/1394] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:10:43 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 28663 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:10:44.661481 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-be5bac37-5260-4e93-9c76-8069f32bc4ce tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:10:44.662463 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-be5bac37-5260-4e93-9c76-8069f32bc4ce tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:10:44.668904 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-be5bac37-5260-4e93-9c76-8069f32bc4ce tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:44.669347 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-be5bac37-5260-4e93-9c76-8069f32bc4ce tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:44.670102 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-be5bac37-5260-4e93-9c76-8069f32bc4ce tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:44.670529 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-be5bac37-5260-4e93-9c76-8069f32bc4ce tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:44.750131 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-be5bac37-5260-4e93-9c76-8069f32bc4ce tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 28663 microversion: 2.1 time: 0.092053 Aug 07 05:10:44.750750 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 718/1395] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:10:44 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 28663 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 07 05:10:45.762193 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-16d9b665-f48e-4e7d-8c2e-8d78e0a83399 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:10:45.763191 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-16d9b665-f48e-4e7d-8c2e-8d78e0a83399 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:10:45.769965 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-16d9b665-f48e-4e7d-8c2e-8d78e0a83399 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:45.770418 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-16d9b665-f48e-4e7d-8c2e-8d78e0a83399 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:45.771184 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-16d9b665-f48e-4e7d-8c2e-8d78e0a83399 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:45.771637 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-16d9b665-f48e-4e7d-8c2e-8d78e0a83399 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:45.857903 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-16d9b665-f48e-4e7d-8c2e-8d78e0a83399 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 28663 microversion: 2.1 time: 0.099649 Aug 07 05:10:45.858578 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 678/1396] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:10:45 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 28663 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:10:46.870103 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-ffa283d4-d7d3-43f6-90f1-419dba765392 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:10:46.871014 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-ffa283d4-d7d3-43f6-90f1-419dba765392 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:10:46.877809 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ffa283d4-d7d3-43f6-90f1-419dba765392 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:46.878262 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ffa283d4-d7d3-43f6-90f1-419dba765392 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:46.879028 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ffa283d4-d7d3-43f6-90f1-419dba765392 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:46.879460 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ffa283d4-d7d3-43f6-90f1-419dba765392 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:46.973698 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-ffa283d4-d7d3-43f6-90f1-419dba765392 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 28663 microversion: 2.1 time: 0.107575 Aug 07 05:10:46.974609 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 719/1397] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:10:46 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 28663 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 07 05:10:47.986290 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-5bfb425a-197b-4d59-bb48-d2c8f2a0cd2e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:10:47.987188 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-5bfb425a-197b-4d59-bb48-d2c8f2a0cd2e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:10:47.993935 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5bfb425a-197b-4d59-bb48-d2c8f2a0cd2e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:47.994378 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5bfb425a-197b-4d59-bb48-d2c8f2a0cd2e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:47.995136 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5bfb425a-197b-4d59-bb48-d2c8f2a0cd2e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:47.995563 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-5bfb425a-197b-4d59-bb48-d2c8f2a0cd2e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:48.075218 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-5bfb425a-197b-4d59-bb48-d2c8f2a0cd2e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 28663 microversion: 2.1 time: 0.093027 Aug 07 05:10:48.075825 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 679/1398] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:10:47 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 28663 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:10:49.088543 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-df792db1-6418-4927-ac06-1bd5a4363b60 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:10:49.089618 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-df792db1-6418-4927-ac06-1bd5a4363b60 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:10:49.096981 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-df792db1-6418-4927-ac06-1bd5a4363b60 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:49.097432 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-df792db1-6418-4927-ac06-1bd5a4363b60 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:49.098203 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-df792db1-6418-4927-ac06-1bd5a4363b60 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:49.098635 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-df792db1-6418-4927-ac06-1bd5a4363b60 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:49.182081 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-df792db1-6418-4927-ac06-1bd5a4363b60 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 28663 microversion: 2.1 time: 0.098467 Aug 07 05:10:49.182784 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 720/1399] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:10:49 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 28663 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:10:50.194150 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-76b7dd25-6434-4e81-bbf3-2afc27b081fa tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:10:50.195123 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-76b7dd25-6434-4e81-bbf3-2afc27b081fa tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:10:50.201554 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-76b7dd25-6434-4e81-bbf3-2afc27b081fa tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:50.201991 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-76b7dd25-6434-4e81-bbf3-2afc27b081fa tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:50.202850 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-76b7dd25-6434-4e81-bbf3-2afc27b081fa tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:50.203278 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-76b7dd25-6434-4e81-bbf3-2afc27b081fa tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:50.285274 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-76b7dd25-6434-4e81-bbf3-2afc27b081fa tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 28663 microversion: 2.1 time: 0.095077 Aug 07 05:10:50.286124 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 680/1400] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:10:50 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 28663 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:10:51.297738 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-74e9e6b4-4b16-4731-942f-c32582adbccc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:10:51.298733 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-74e9e6b4-4b16-4731-942f-c32582adbccc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:10:51.305267 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-74e9e6b4-4b16-4731-942f-c32582adbccc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:51.305717 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-74e9e6b4-4b16-4731-942f-c32582adbccc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:51.306480 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-74e9e6b4-4b16-4731-942f-c32582adbccc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:51.306914 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-74e9e6b4-4b16-4731-942f-c32582adbccc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:51.386722 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-74e9e6b4-4b16-4731-942f-c32582adbccc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 28663 microversion: 2.1 time: 0.093224 Aug 07 05:10:51.387265 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 721/1401] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:10:51 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 28663 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:10:52.399611 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-2a525247-526f-45b8-8562-c1d492016502 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:10:52.400516 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-2a525247-526f-45b8-8562-c1d492016502 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:10:52.407840 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2a525247-526f-45b8-8562-c1d492016502 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:52.408284 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2a525247-526f-45b8-8562-c1d492016502 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:52.409102 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2a525247-526f-45b8-8562-c1d492016502 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:52.409530 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2a525247-526f-45b8-8562-c1d492016502 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:52.506411 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-2a525247-526f-45b8-8562-c1d492016502 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 29554 microversion: 2.1 time: 0.110789 Aug 07 05:10:52.507032 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 681/1402] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:10:52 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 29554 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:10:53.518554 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-bfb0a9b3-df09-4678-a662-67702b1f4339 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:10:53.519579 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-bfb0a9b3-df09-4678-a662-67702b1f4339 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:10:53.526076 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-bfb0a9b3-df09-4678-a662-67702b1f4339 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:53.526521 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-bfb0a9b3-df09-4678-a662-67702b1f4339 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:53.527279 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-bfb0a9b3-df09-4678-a662-67702b1f4339 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:53.527711 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-bfb0a9b3-df09-4678-a662-67702b1f4339 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:53.621219 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-bfb0a9b3-df09-4678-a662-67702b1f4339 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 31756 microversion: 2.1 time: 0.106505 Aug 07 05:10:53.622108 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 722/1403] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:10:53 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 31756 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:10:54.634222 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-0a786dd1-1d66-4211-8b29-2957da1ab89e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:10:54.635376 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-0a786dd1-1d66-4211-8b29-2957da1ab89e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:10:54.642660 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0a786dd1-1d66-4211-8b29-2957da1ab89e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:54.643105 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0a786dd1-1d66-4211-8b29-2957da1ab89e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:54.643878 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0a786dd1-1d66-4211-8b29-2957da1ab89e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:54.644311 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0a786dd1-1d66-4211-8b29-2957da1ab89e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:54.731764 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-0a786dd1-1d66-4211-8b29-2957da1ab89e tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 33258 microversion: 2.1 time: 0.101516 Aug 07 05:10:54.732648 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 682/1404] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:10:54 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 33258 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:10:55.744565 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-8a874252-ef30-4a65-86d8-e3f178a99571 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:10:55.745576 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-8a874252-ef30-4a65-86d8-e3f178a99571 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:10:55.752601 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8a874252-ef30-4a65-86d8-e3f178a99571 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:55.753072 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8a874252-ef30-4a65-86d8-e3f178a99571 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:55.753829 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8a874252-ef30-4a65-86d8-e3f178a99571 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:55.754258 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8a874252-ef30-4a65-86d8-e3f178a99571 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:55.848969 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-8a874252-ef30-4a65-86d8-e3f178a99571 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 34235 microversion: 2.1 time: 0.108268 Aug 07 05:10:55.849867 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 723/1405] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:10:55 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 34235 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:10:56.861219 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-57bdd2a5-bb0e-4db2-b50e-183f3c2c6d05 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:10:56.862196 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-57bdd2a5-bb0e-4db2-b50e-183f3c2c6d05 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:10:56.868776 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-57bdd2a5-bb0e-4db2-b50e-183f3c2c6d05 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:56.869189 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-57bdd2a5-bb0e-4db2-b50e-183f3c2c6d05 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:56.869945 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-57bdd2a5-bb0e-4db2-b50e-183f3c2c6d05 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:56.870370 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-57bdd2a5-bb0e-4db2-b50e-183f3c2c6d05 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:56.958634 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-57bdd2a5-bb0e-4db2-b50e-183f3c2c6d05 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 35504 microversion: 2.1 time: 0.101410 Aug 07 05:10:56.959250 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 683/1406] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:10:56 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 35504 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:10:57.971392 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-2d5ecfdd-9cf4-4d2f-84cc-bf45989371b1 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:10:57.972305 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-2d5ecfdd-9cf4-4d2f-84cc-bf45989371b1 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:10:57.978828 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2d5ecfdd-9cf4-4d2f-84cc-bf45989371b1 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:57.979276 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2d5ecfdd-9cf4-4d2f-84cc-bf45989371b1 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:57.980040 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2d5ecfdd-9cf4-4d2f-84cc-bf45989371b1 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:57.980470 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2d5ecfdd-9cf4-4d2f-84cc-bf45989371b1 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:58.085971 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-2d5ecfdd-9cf4-4d2f-84cc-bf45989371b1 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 37052 microversion: 2.1 time: 0.118802 Aug 07 05:10:58.086843 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 724/1407] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:10:57 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 37052 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:10:59.099598 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-d1589067-be54-4163-bbcf-c613be3cd620 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:10:59.101108 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-d1589067-be54-4163-bbcf-c613be3cd620 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:10:59.107674 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d1589067-be54-4163-bbcf-c613be3cd620 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:59.108112 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d1589067-be54-4163-bbcf-c613be3cd620 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:59.108912 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d1589067-be54-4163-bbcf-c613be3cd620 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:10:59.109347 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d1589067-be54-4163-bbcf-c613be3cd620 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:10:59.200595 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-d1589067-be54-4163-bbcf-c613be3cd620 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 38192 microversion: 2.1 time: 0.106116 Aug 07 05:10:59.201503 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 684/1408] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:10:59 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 38192 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:11:00.213807 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-c15186cd-539d-4984-adc3-5a4f65cdec49 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:11:00.214796 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-c15186cd-539d-4984-adc3-5a4f65cdec49 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:11:00.222542 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c15186cd-539d-4984-adc3-5a4f65cdec49 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:11:00.222989 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c15186cd-539d-4984-adc3-5a4f65cdec49 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:11:00.223754 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c15186cd-539d-4984-adc3-5a4f65cdec49 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:11:00.224186 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-c15186cd-539d-4984-adc3-5a4f65cdec49 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:11:00.303657 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-c15186cd-539d-4984-adc3-5a4f65cdec49 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 38192 microversion: 2.1 time: 0.093793 Aug 07 05:11:00.304267 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 725/1409] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:11:00 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 38192 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:11:01.316174 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-280a3bbd-8bbe-4a81-aafa-f6e0b6f24780 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:11:01.317187 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-280a3bbd-8bbe-4a81-aafa-f6e0b6f24780 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:11:01.323625 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-280a3bbd-8bbe-4a81-aafa-f6e0b6f24780 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:11:01.324069 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-280a3bbd-8bbe-4a81-aafa-f6e0b6f24780 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:11:01.324851 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-280a3bbd-8bbe-4a81-aafa-f6e0b6f24780 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:11:01.325282 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-280a3bbd-8bbe-4a81-aafa-f6e0b6f24780 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:11:01.405748 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-280a3bbd-8bbe-4a81-aafa-f6e0b6f24780 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 38192 microversion: 2.1 time: 0.093508 Aug 07 05:11:01.406289 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 685/1410] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:11:01 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 38192 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:11:02.418805 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-86bbdce8-91d4-40f5-9670-e346ae8653c6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:11:02.419768 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-86bbdce8-91d4-40f5-9670-e346ae8653c6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:11:02.427344 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-86bbdce8-91d4-40f5-9670-e346ae8653c6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:11:02.427788 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-86bbdce8-91d4-40f5-9670-e346ae8653c6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:11:02.428558 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-86bbdce8-91d4-40f5-9670-e346ae8653c6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:11:02.429020 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-86bbdce8-91d4-40f5-9670-e346ae8653c6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:11:02.510396 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-86bbdce8-91d4-40f5-9670-e346ae8653c6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 38192 microversion: 2.1 time: 0.095625 Aug 07 05:11:02.511026 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 726/1411] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:11:02 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 38192 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:11:03.523025 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-0314d817-ff00-46c1-9914-4f4da1aba682 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:11:03.523937 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-0314d817-ff00-46c1-9914-4f4da1aba682 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:11:03.530489 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0314d817-ff00-46c1-9914-4f4da1aba682 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:11:03.530936 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0314d817-ff00-46c1-9914-4f4da1aba682 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:11:03.532237 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0314d817-ff00-46c1-9914-4f4da1aba682 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:11:03.532682 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0314d817-ff00-46c1-9914-4f4da1aba682 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:11:03.621419 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-0314d817-ff00-46c1-9914-4f4da1aba682 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action" status: 200 len: 38321 microversion: 2.1 time: 0.102311 Aug 07 05:11:03.622094 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 686/1412] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:11:03 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/action => generated 38321 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 05:11:03.632626 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-6d4f018e-df9d-43c3-9de7-05289a109bed tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:11:03.633241 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-6d4f018e-df9d-43c3-9de7-05289a109bed tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:11:03.639802 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6d4f018e-df9d-43c3-9de7-05289a109bed tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:11:03.640253 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6d4f018e-df9d-43c3-9de7-05289a109bed tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:11:03.641108 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6d4f018e-df9d-43c3-9de7-05289a109bed tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:11:03.641578 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6d4f018e-df9d-43c3-9de7-05289a109bed tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:11:03.664670 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-6d4f018e-df9d-43c3-9de7-05289a109bed tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/ips" status: 200 len: 146 microversion: 2.1 time: 0.036095 Aug 07 05:11:03.665258 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 727/1413] 10.222.0.35 () {58 vars in 1248 bytes} [Sat Aug 7 05:11:03 2021] GET /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/ips => generated 146 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 05:11:04.981188 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-d7e84994-e820-4010-9a42-6a2805705fbc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ac027bfc-6bda-4a50-856d-b2d3d3b0f226"}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:11:04.982355 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-d7e84994-e820-4010-9a42-6a2805705fbc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:11:04.989652 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d7e84994-e820-4010-9a42-6a2805705fbc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:11:04.990101 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d7e84994-e820-4010-9a42-6a2805705fbc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:11:04.990868 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d7e84994-e820-4010-9a42-6a2805705fbc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:11:04.991302 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d7e84994-e820-4010-9a42-6a2805705fbc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:11:05.235099 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-d7e84994-e820-4010-9a42-6a2805705fbc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.257358 Aug 07 05:11:05.235829 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 687/1414] 10.222.0.35 () {60 vars in 1323 bytes} [Sat Aug 7 05:11:04 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/os-volume_attachments => generated 194 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 05:11:12.738183 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-499c5706-fa64-45a7-b64f-e69cc138a677 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:11:12.739081 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-499c5706-fa64-45a7-b64f-e69cc138a677 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:11:12.745709 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-499c5706-fa64-45a7-b64f-e69cc138a677 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:11:12.746149 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-499c5706-fa64-45a7-b64f-e69cc138a677 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:11:12.746905 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-499c5706-fa64-45a7-b64f-e69cc138a677 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:11:12.747332 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-499c5706-fa64-45a7-b64f-e69cc138a677 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:11:12.776925 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-499c5706-fa64-45a7-b64f-e69cc138a677 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042670 Aug 07 05:11:12.777454 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 728/1415] 10.222.0.35 () {58 vars in 1302 bytes} [Sat Aug 7 05:11:12 2021] GET /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 05:11:12.788175 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-c1b248b2-ea0e-47af-b27d-d9afc14aede2 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:11:12.788759 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-c1b248b2-ea0e-47af-b27d-d9afc14aede2 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:11:12.794884 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c1b248b2-ea0e-47af-b27d-d9afc14aede2 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:11:12.795328 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c1b248b2-ea0e-47af-b27d-d9afc14aede2 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:11:12.796090 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c1b248b2-ea0e-47af-b27d-d9afc14aede2 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:11:12.796523 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c1b248b2-ea0e-47af-b27d-d9afc14aede2 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:11:12.825906 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-c1b248b2-ea0e-47af-b27d-d9afc14aede2 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/os-volume_attachments/ac027bfc-6bda-4a50-856d-b2d3d3b0f226" status: 200 len: 194 microversion: 2.1 time: 0.042412 Aug 07 05:11:12.826467 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 688/1416] 10.222.0.35 () {58 vars in 1413 bytes} [Sat Aug 7 05:11:12 2021] GET /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/os-volume_attachments/ac027bfc-6bda-4a50-856d-b2d3d3b0f226 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 05:11:12.851275 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 05:11:12.851490 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: Sat Aug 7 05:11:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 05:11:14.137788 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-31426b7c-24ac-4645-b84e-3cf04b4c277d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f13b0aa1-72d4-4066-93f9-164336b01c28"}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:11:14.138868 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-31426b7c-24ac-4645-b84e-3cf04b4c277d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:11:14.145356 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-31426b7c-24ac-4645-b84e-3cf04b4c277d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:11:14.145808 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-31426b7c-24ac-4645-b84e-3cf04b4c277d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:11:14.146648 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-31426b7c-24ac-4645-b84e-3cf04b4c277d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:11:14.147087 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-31426b7c-24ac-4645-b84e-3cf04b4c277d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:11:14.395778 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-31426b7c-24ac-4645-b84e-3cf04b4c277d tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.261159 Aug 07 05:11:14.396361 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 729/1417] 10.222.0.35 () {60 vars in 1323 bytes} [Sat Aug 7 05:11:14 2021] POST /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/os-volume_attachments => generated 194 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 05:11:21.898357 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-87685892-7b03-406c-ab36-a4d3a4abd5b6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:11:21.899329 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-87685892-7b03-406c-ab36-a4d3a4abd5b6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:11:21.905622 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-87685892-7b03-406c-ab36-a4d3a4abd5b6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:11:21.906902 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-87685892-7b03-406c-ab36-a4d3a4abd5b6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:11:21.907668 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-87685892-7b03-406c-ab36-a4d3a4abd5b6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:11:21.908102 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-87685892-7b03-406c-ab36-a4d3a4abd5b6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:11:21.937151 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-87685892-7b03-406c-ab36-a4d3a4abd5b6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042495 Aug 07 05:11:21.937711 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 689/1418] 10.222.0.35 () {58 vars in 1302 bytes} [Sat Aug 7 05:11:21 2021] GET /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 05:11:22.120333 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-7ee49cde-82ac-47e8-88ea-e1f8ff2f5ac9 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:11:22.120941 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-7ee49cde-82ac-47e8-88ea-e1f8ff2f5ac9 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:11:22.128188 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-7ee49cde-82ac-47e8-88ea-e1f8ff2f5ac9 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:11:22.128582 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-7ee49cde-82ac-47e8-88ea-e1f8ff2f5ac9 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:11:22.129381 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-7ee49cde-82ac-47e8-88ea-e1f8ff2f5ac9 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:11:22.129820 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-7ee49cde-82ac-47e8-88ea-e1f8ff2f5ac9 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:11:22.159032 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-7ee49cde-82ac-47e8-88ea-e1f8ff2f5ac9 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/os-volume_attachments/ac027bfc-6bda-4a50-856d-b2d3d3b0f226" status: 200 len: 194 microversion: 2.1 time: 0.042844 Aug 07 05:11:22.159592 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 730/1419] 10.222.0.35 () {58 vars in 1413 bytes} [Sat Aug 7 05:11:22 2021] GET /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/os-volume_attachments/ac027bfc-6bda-4a50-856d-b2d3d3b0f226 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 05:11:22.168940 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-79a08033-52ca-4e4a-af03-b5c1b3c9aacc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:11:22.169432 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-79a08033-52ca-4e4a-af03-b5c1b3c9aacc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:11:22.175347 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-79a08033-52ca-4e4a-af03-b5c1b3c9aacc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:11:22.175791 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-79a08033-52ca-4e4a-af03-b5c1b3c9aacc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:11:22.176553 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-79a08033-52ca-4e4a-af03-b5c1b3c9aacc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:11:22.177024 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-79a08033-52ca-4e4a-af03-b5c1b3c9aacc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:11:22.260433 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.objects.instance [None req-79a08033-52ca-4e4a-af03-b5c1b3c9aacc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lazy-loading 'services' on Instance uuid 6c6f88d1-221f-41c3-858c-362ff1d02f0b {{(pid=107485) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 05:11:22.324297 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-79a08033-52ca-4e4a-af03-b5c1b3c9aacc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "DELETE /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/os-volume_attachments/ac027bfc-6bda-4a50-856d-b2d3d3b0f226" status: 202 len: 0 microversion: 2.1 time: 0.158981 Aug 07 05:11:22.324917 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 690/1420] 10.222.0.35 () {58 vars in 1416 bytes} [Sat Aug 7 05:11:22 2021] DELETE /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/os-volume_attachments/ac027bfc-6bda-4a50-856d-b2d3d3b0f226 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:11:24.491582 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-e259be3f-bc46-4288-a819-76dbc28dce4c tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:11:24.492075 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-e259be3f-bc46-4288-a819-76dbc28dce4c tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:11:24.498307 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e259be3f-bc46-4288-a819-76dbc28dce4c tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:11:24.498744 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e259be3f-bc46-4288-a819-76dbc28dce4c tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:11:24.499521 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e259be3f-bc46-4288-a819-76dbc28dce4c tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:11:24.500525 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-e259be3f-bc46-4288-a819-76dbc28dce4c tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:11:24.528101 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-e259be3f-bc46-4288-a819-76dbc28dce4c tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/os-volume_attachments/f13b0aa1-72d4-4066-93f9-164336b01c28" status: 200 len: 194 microversion: 2.1 time: 0.040272 Aug 07 05:11:24.528649 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 731/1421] 10.222.0.35 () {58 vars in 1413 bytes} [Sat Aug 7 05:11:24 2021] GET /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/os-volume_attachments/f13b0aa1-72d4-4066-93f9-164336b01c28 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 05:11:24.538508 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-0bc35b3b-3899-4a32-b3af-e0c20b111be9 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:11:24.539084 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-0bc35b3b-3899-4a32-b3af-e0c20b111be9 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:11:24.545044 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0bc35b3b-3899-4a32-b3af-e0c20b111be9 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:11:24.545485 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0bc35b3b-3899-4a32-b3af-e0c20b111be9 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:11:24.546243 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0bc35b3b-3899-4a32-b3af-e0c20b111be9 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:11:24.547229 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0bc35b3b-3899-4a32-b3af-e0c20b111be9 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:11:24.629017 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.objects.instance [None req-0bc35b3b-3899-4a32-b3af-e0c20b111be9 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lazy-loading 'services' on Instance uuid 6c6f88d1-221f-41c3-858c-362ff1d02f0b {{(pid=107485) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 05:11:24.692986 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-0bc35b3b-3899-4a32-b3af-e0c20b111be9 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "DELETE /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/os-volume_attachments/f13b0aa1-72d4-4066-93f9-164336b01c28" status: 202 len: 0 microversion: 2.1 time: 0.158299 Aug 07 05:11:24.693560 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 691/1422] 10.222.0.35 () {58 vars in 1416 bytes} [Sat Aug 7 05:11:24 2021] DELETE /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/os-volume_attachments/f13b0aa1-72d4-4066-93f9-164336b01c28 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:11:25.859955 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-7c40198c-2c00-4827-8551-a7ff3d0f3da6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:11:25.860903 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-7c40198c-2c00-4827-8551-a7ff3d0f3da6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:11:25.866688 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-7c40198c-2c00-4827-8551-a7ff3d0f3da6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:11:25.867153 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-7c40198c-2c00-4827-8551-a7ff3d0f3da6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:11:25.867898 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-7c40198c-2c00-4827-8551-a7ff3d0f3da6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:11:25.868329 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-7c40198c-2c00-4827-8551-a7ff3d0f3da6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:11:25.898093 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-7c40198c-2c00-4827-8551-a7ff3d0f3da6 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042158 Aug 07 05:11:25.898646 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 732/1423] 10.222.0.35 () {58 vars in 1302 bytes} [Sat Aug 7 05:11:25 2021] GET /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 05:11:26.013456 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-338cee0b-ad55-4b11-a140-85dc4df769f9 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:11:26.014419 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-338cee0b-ad55-4b11-a140-85dc4df769f9 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:11:26.021040 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-338cee0b-ad55-4b11-a140-85dc4df769f9 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:11:26.021490 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-338cee0b-ad55-4b11-a140-85dc4df769f9 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:11:26.022258 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-338cee0b-ad55-4b11-a140-85dc4df769f9 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:11:26.022689 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-338cee0b-ad55-4b11-a140-85dc4df769f9 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:11:26.050259 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-338cee0b-ad55-4b11-a140-85dc4df769f9 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041523 Aug 07 05:11:26.050797 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 692/1424] 10.222.0.35 () {58 vars in 1302 bytes} [Sat Aug 7 05:11:26 2021] GET /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 05:11:26.109546 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-41b459f6-10f3-4254-9a3b-27068ee4cbbc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:11:26.110044 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-41b459f6-10f3-4254-9a3b-27068ee4cbbc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:11:26.115958 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-41b459f6-10f3-4254-9a3b-27068ee4cbbc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:11:26.116398 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-41b459f6-10f3-4254-9a3b-27068ee4cbbc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:11:26.117192 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-41b459f6-10f3-4254-9a3b-27068ee4cbbc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:11:26.117625 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-41b459f6-10f3-4254-9a3b-27068ee4cbbc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:11:26.142786 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-41b459f6-10f3-4254-9a3b-27068ee4cbbc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Going to try to terminate instance {{(pid=107486) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 07 05:11:26.215326 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-41b459f6-10f3-4254-9a3b-27068ee4cbbc tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "DELETE /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b" status: 204 len: 0 microversion: 2.1 time: 0.109151 Aug 07 05:11:26.215937 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 733/1425] 10.222.0.35 () {58 vars in 1239 bytes} [Sat Aug 7 05:11:26 2021] DELETE /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 05:11:26.224212 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-91ec48fd-1b35-4522-8e9e-a59f5ade3f49 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:11:26.224849 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-91ec48fd-1b35-4522-8e9e-a59f5ade3f49 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:11:26.230597 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-91ec48fd-1b35-4522-8e9e-a59f5ade3f49 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:11:26.231033 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-91ec48fd-1b35-4522-8e9e-a59f5ade3f49 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:11:26.231793 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-91ec48fd-1b35-4522-8e9e-a59f5ade3f49 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:11:26.232222 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-91ec48fd-1b35-4522-8e9e-a59f5ade3f49 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:11:26.360144 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-91ec48fd-1b35-4522-8e9e-a59f5ade3f49 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5472ec0a0ae74e9bbf00e2bcf5db21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8063f2f6d64b79928f170fd6d99da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:11:26.367631 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-91ec48fd-1b35-4522-8e9e-a59f5ade3f49 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b" status: 200 len: 1672 microversion: 2.1 time: 0.146984 Aug 07 05:11:26.368201 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 693/1426] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:11:26 2021] GET /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b => generated 1672 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:11:27.386309 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-469da1e3-fc7a-429d-8561-9f491fd6760f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:11:27.386997 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-469da1e3-fc7a-429d-8561-9f491fd6760f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:11:27.393600 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-469da1e3-fc7a-429d-8561-9f491fd6760f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:11:27.394036 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-469da1e3-fc7a-429d-8561-9f491fd6760f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:11:27.394790 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-469da1e3-fc7a-429d-8561-9f491fd6760f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:11:27.395211 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-469da1e3-fc7a-429d-8561-9f491fd6760f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:11:27.514101 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-469da1e3-fc7a-429d-8561-9f491fd6760f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5472ec0a0ae74e9bbf00e2bcf5db21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8063f2f6d64b79928f170fd6d99da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:11:27.521502 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-469da1e3-fc7a-429d-8561-9f491fd6760f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b" status: 200 len: 1672 microversion: 2.1 time: 0.139252 Aug 07 05:11:27.522062 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 734/1427] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:11:27 2021] GET /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b => generated 1672 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:11:28.538097 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-1da5bc17-6474-4b20-b69b-61404e4e0d7f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:11:28.538648 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-1da5bc17-6474-4b20-b69b-61404e4e0d7f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:11:28.544443 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1da5bc17-6474-4b20-b69b-61404e4e0d7f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:11:28.544930 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1da5bc17-6474-4b20-b69b-61404e4e0d7f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:11:28.545707 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1da5bc17-6474-4b20-b69b-61404e4e0d7f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:11:28.546145 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1da5bc17-6474-4b20-b69b-61404e4e0d7f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:11:28.726575 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-1da5bc17-6474-4b20-b69b-61404e4e0d7f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5472ec0a0ae74e9bbf00e2bcf5db21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8063f2f6d64b79928f170fd6d99da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:11:28.733822 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-1da5bc17-6474-4b20-b69b-61404e4e0d7f tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b" status: 200 len: 1672 microversion: 2.1 time: 0.199532 Aug 07 05:11:28.734552 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 694/1428] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:11:28 2021] GET /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b => generated 1672 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:11:29.414228 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [req-d5fec17a-7df2-40e9-a97e-744a3d8212d1 req-5340e284-955d-4791-bf41-d12e975151a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c6f88d1-221f-41c3-858c-362ff1d02f0b", "name": "network-vif-deleted", "tag": "e2105386-6935-4bf2-8bcc-97388a21e95a"}]} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:11:29.415839 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 05:11:29.415839 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: warnings.warn(msg) Aug 07 05:11:29.422807 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-d5fec17a-7df2-40e9-a97e-744a3d8212d1 req-5340e284-955d-4791-bf41-d12e975151a1 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:11:29.423248 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-d5fec17a-7df2-40e9-a97e-744a3d8212d1 req-5340e284-955d-4791-bf41-d12e975151a1 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:11:29.435043 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.compute.server_external_events [req-d5fec17a-7df2-40e9-a97e-744a3d8212d1 req-5340e284-955d-4791-bf41-d12e975151a1 service nova] Creating event network-vif-deleted:e2105386-6935-4bf2-8bcc-97388a21e95a for instance 6c6f88d1-221f-41c3-858c-362ff1d02f0b on hv-cinder-80374 Aug 07 05:11:29.440454 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [req-d5fec17a-7df2-40e9-a97e-744a3d8212d1 req-5340e284-955d-4791-bf41-d12e975151a1 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087518 Aug 07 05:11:29.441517 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 735/1429] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 05:11:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 05:11:29.750158 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-80d302c2-68f3-4a2d-a68f-5ac03441910c tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:11:29.751071 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-80d302c2-68f3-4a2d-a68f-5ac03441910c tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:11:29.757120 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-80d302c2-68f3-4a2d-a68f-5ac03441910c tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:11:29.757561 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-80d302c2-68f3-4a2d-a68f-5ac03441910c tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:11:29.758326 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-80d302c2-68f3-4a2d-a68f-5ac03441910c tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:11:29.758750 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-80d302c2-68f3-4a2d-a68f-5ac03441910c tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:11:29.791057 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-80d302c2-68f3-4a2d-a68f-5ac03441910c tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:11:29.791502 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-80d302c2-68f3-4a2d-a68f-5ac03441910c tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:11:29.791951 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.objects.instance [None req-80d302c2-68f3-4a2d-a68f-5ac03441910c tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lazy-loading 'fault' on Instance uuid 6c6f88d1-221f-41c3-858c-362ff1d02f0b {{(pid=107485) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 05:11:29.832367 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-80d302c2-68f3-4a2d-a68f-5ac03441910c tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5472ec0a0ae74e9bbf00e2bcf5db21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8063f2f6d64b79928f170fd6d99da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:11:29.840106 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-80d302c2-68f3-4a2d-a68f-5ac03441910c tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b" status: 200 len: 1327 microversion: 2.1 time: 0.093586 Aug 07 05:11:29.840691 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 695/1430] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:11:29 2021] GET /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b => generated 1327 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:11:30.858475 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-4a9e7fbb-be13-4f75-be78-b66ff5d92b09 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:11:30.859240 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-4a9e7fbb-be13-4f75-be78-b66ff5d92b09 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:11:30.865285 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4a9e7fbb-be13-4f75-be78-b66ff5d92b09 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:11:30.865769 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4a9e7fbb-be13-4f75-be78-b66ff5d92b09 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:11:30.866478 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4a9e7fbb-be13-4f75-be78-b66ff5d92b09 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:11:30.866902 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4a9e7fbb-be13-4f75-be78-b66ff5d92b09 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:11:30.879517 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.wsgi [None req-4a9e7fbb-be13-4f75-be78-b66ff5d92b09 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] HTTP exception thrown: Instance 6c6f88d1-221f-41c3-858c-362ff1d02f0b could not be found. Aug 07 05:11:30.880089 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-4a9e7fbb-be13-4f75-be78-b66ff5d92b09 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Returning 404 to user: Instance 6c6f88d1-221f-41c3-858c-362ff1d02f0b could not be found. {{(pid=107486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 07 05:11:30.880939 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-4a9e7fbb-be13-4f75-be78-b66ff5d92b09 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b" status: 404 len: 111 microversion: 2.1 time: 0.026472 Aug 07 05:11:30.881441 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 736/1431] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:11:30 2021] GET /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 05:11:30.889435 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-01a0a9db-23c6-43ff-991e-81b869529052 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '.version_select at 0x7f75ebe983a0>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:11:30.907310 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-01a0a9db-23c6-43ff-991e-81b869529052 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2090056158" status: 202 len: 0 microversion: 2.1 time: 0.021403 Aug 07 05:11:30.907871 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 696/1432] 10.222.0.35 () {58 vars in 1221 bytes} [Sat Aug 7 05:11:30 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2090056158 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:11:33.779320 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-d6fc3f99-a981-4a37-b75f-b4b9d8d48ca7 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:11:33.779796 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-d6fc3f99-a981-4a37-b75f-b4b9d8d48ca7 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:11:33.785765 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d6fc3f99-a981-4a37-b75f-b4b9d8d48ca7 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:11:33.786205 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d6fc3f99-a981-4a37-b75f-b4b9d8d48ca7 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:11:33.786954 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d6fc3f99-a981-4a37-b75f-b4b9d8d48ca7 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:11:33.787382 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-d6fc3f99-a981-4a37-b75f-b4b9d8d48ca7 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:11:33.800912 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.wsgi [None req-d6fc3f99-a981-4a37-b75f-b4b9d8d48ca7 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] HTTP exception thrown: Instance 6c6f88d1-221f-41c3-858c-362ff1d02f0b could not be found. Aug 07 05:11:33.801482 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-d6fc3f99-a981-4a37-b75f-b4b9d8d48ca7 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Returning 404 to user: Instance 6c6f88d1-221f-41c3-858c-362ff1d02f0b could not be found. {{(pid=107486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 07 05:11:33.802281 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-d6fc3f99-a981-4a37-b75f-b4b9d8d48ca7 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "DELETE /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b" status: 404 len: 111 microversion: 2.1 time: 0.026605 Aug 07 05:11:33.802779 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 737/1433] 10.222.0.35 () {58 vars in 1239 bytes} [Sat Aug 7 05:11:33 2021] DELETE /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 05:11:33.810517 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-c2117e3f-c7fa-4b98-95b9-98084bae3511 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:11:33.811123 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-c2117e3f-c7fa-4b98-95b9-98084bae3511 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: 6c6f88d1-221f-41c3-858c-362ff1d02f0b] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:11:33.817610 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c2117e3f-c7fa-4b98-95b9-98084bae3511 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:11:33.818046 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c2117e3f-c7fa-4b98-95b9-98084bae3511 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:11:33.818801 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c2117e3f-c7fa-4b98-95b9-98084bae3511 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:11:33.819229 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c2117e3f-c7fa-4b98-95b9-98084bae3511 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:11:33.832875 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.wsgi [None req-c2117e3f-c7fa-4b98-95b9-98084bae3511 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] HTTP exception thrown: Instance 6c6f88d1-221f-41c3-858c-362ff1d02f0b could not be found. Aug 07 05:11:33.833457 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-c2117e3f-c7fa-4b98-95b9-98084bae3511 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Returning 404 to user: Instance 6c6f88d1-221f-41c3-858c-362ff1d02f0b could not be found. {{(pid=107485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 07 05:11:33.834292 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-c2117e3f-c7fa-4b98-95b9-98084bae3511 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b" status: 404 len: 111 microversion: 2.1 time: 0.027488 Aug 07 05:11:33.834800 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 697/1434] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:11:33 2021] GET /compute/v2.1/servers/6c6f88d1-221f-41c3-858c-362ff1d02f0b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 05:11:34.970606 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-ff60531d-bd20-48e4-aff0-02b4d8cce3bb tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:11:34.971098 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-ff60531d-bd20-48e4-aff0-02b4d8cce3bb tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:11:34.976892 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ff60531d-bd20-48e4-aff0-02b4d8cce3bb tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:11:34.977355 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ff60531d-bd20-48e4-aff0-02b4d8cce3bb tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:11:34.978117 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ff60531d-bd20-48e4-aff0-02b4d8cce3bb tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:11:34.978548 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ff60531d-bd20-48e4-aff0-02b4d8cce3bb tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:11:34.992261 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.wsgi [None req-ff60531d-bd20-48e4-aff0-02b4d8cce3bb tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] HTTP exception thrown: Instance e3ca5865-7170-4012-b7fa-3c65e878a186 could not be found. Aug 07 05:11:34.992871 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-ff60531d-bd20-48e4-aff0-02b4d8cce3bb tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Returning 404 to user: Instance e3ca5865-7170-4012-b7fa-3c65e878a186 could not be found. {{(pid=107486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 07 05:11:34.993679 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-ff60531d-bd20-48e4-aff0-02b4d8cce3bb tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "DELETE /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186" status: 404 len: 111 microversion: 2.1 time: 0.027515 Aug 07 05:11:34.994184 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 738/1435] 10.222.0.35 () {58 vars in 1239 bytes} [Sat Aug 7 05:11:34 2021] DELETE /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 05:11:35.001692 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-52442647-330c-4c2f-b675-981374c7ded1 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:11:35.002297 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-52442647-330c-4c2f-b675-981374c7ded1 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] [instance: e3ca5865-7170-4012-b7fa-3c65e878a186] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:11:35.008482 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-52442647-330c-4c2f-b675-981374c7ded1 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:11:35.008960 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-52442647-330c-4c2f-b675-981374c7ded1 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:11:35.009711 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-52442647-330c-4c2f-b675-981374c7ded1 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:11:35.010134 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-52442647-330c-4c2f-b675-981374c7ded1 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:11:35.022853 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.wsgi [None req-52442647-330c-4c2f-b675-981374c7ded1 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] HTTP exception thrown: Instance e3ca5865-7170-4012-b7fa-3c65e878a186 could not be found. Aug 07 05:11:35.023422 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-52442647-330c-4c2f-b675-981374c7ded1 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] Returning 404 to user: Instance e3ca5865-7170-4012-b7fa-3c65e878a186 could not be found. {{(pid=107485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 07 05:11:35.024214 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-52442647-330c-4c2f-b675-981374c7ded1 tempest-AttachVolumeTestJSON-290307593 tempest-AttachVolumeTestJSON-290307593-project] 10.222.0.35 "GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186" status: 404 len: 111 microversion: 2.1 time: 0.026245 Aug 07 05:11:35.024712 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 698/1436] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:11:34 2021] GET /compute/v2.1/servers/e3ca5865-7170-4012-b7fa-3c65e878a186 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 05:11:39.389950 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-f7abb696-ab16-4329-a8de-722f3af29619 tempest-VolumesSnapshotsTestJSON-21055759 tempest-VolumesSnapshotsTestJSON-21055759-project] Action: 'create', calling method: .version_select at 0x7f75f89a7ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-230194844"}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:11:39.670002 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-f7abb696-ab16-4329-a8de-722f3af29619 tempest-VolumesSnapshotsTestJSON-21055759 tempest-VolumesSnapshotsTestJSON-21055759-project] 10.222.0.35 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.390275 Aug 07 05:11:39.670608 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 739/1437] 10.222.0.35 () {60 vars in 1155 bytes} [Sat Aug 7 05:11:39 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 392 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 07 05:11:39.682360 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-9e8b25ce-2593-436d-911e-28ea9c0fbddd tempest-VolumesSnapshotsTestJSON-21055759 tempest-VolumesSnapshotsTestJSON-21055759-project] Calling method '.version_select at 0x7f75ebf265e0>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:11:39.735349 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-9e8b25ce-2593-436d-911e-28ea9c0fbddd tempest-VolumesSnapshotsTestJSON-21055759 tempest-VolumesSnapshotsTestJSON-21055759-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/b8e77ec5-e9a2-438f-b3b7-1a5e4cd0a1d2" status: 200 len: 344 microversion: 2.1 time: 0.057124 Aug 07 05:11:39.735910 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 699/1438] 10.222.0.35 () {58 vars in 1245 bytes} [Sat Aug 7 05:11:39 2021] GET /compute/v2.1/os-volumes/b8e77ec5-e9a2-438f-b3b7-1a5e4cd0a1d2 => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 05:11:40.747137 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-1282bdda-84b2-49b2-b214-75b57881d402 tempest-VolumesSnapshotsTestJSON-21055759 tempest-VolumesSnapshotsTestJSON-21055759-project] Calling method '.version_select at 0x7f75fcda0700>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:11:40.796185 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-1282bdda-84b2-49b2-b214-75b57881d402 tempest-VolumesSnapshotsTestJSON-21055759 tempest-VolumesSnapshotsTestJSON-21055759-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/b8e77ec5-e9a2-438f-b3b7-1a5e4cd0a1d2" status: 200 len: 345 microversion: 2.1 time: 0.052588 Aug 07 05:11:40.797377 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 740/1439] 10.222.0.35 () {58 vars in 1245 bytes} [Sat Aug 7 05:11:40 2021] GET /compute/v2.1/os-volumes/b8e77ec5-e9a2-438f-b3b7-1a5e4cd0a1d2 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 05:11:40.808090 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-2d1e1a17-9563-4088-bf93-356961f2116b tempest-VolumesSnapshotsTestJSON-21055759 tempest-VolumesSnapshotsTestJSON-21055759-project] Action: 'create', calling method: .version_select at 0x7f75ebebb430>, body: {"snapshot": {"volume_id": "b8e77ec5-e9a2-438f-b3b7-1a5e4cd0a1d2", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1298652958"}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:11:40.945180 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-2d1e1a17-9563-4088-bf93-356961f2116b tempest-VolumesSnapshotsTestJSON-21055759 tempest-VolumesSnapshotsTestJSON-21055759-project] 10.222.0.35 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.140558 Aug 07 05:11:40.945754 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 700/1440] 10.222.0.35 () {60 vars in 1162 bytes} [Sat Aug 7 05:11:40 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 05:11:40.955717 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-0fb09457-fca7-4507-a7c0-f99e32df0e92 tempest-VolumesSnapshotsTestJSON-21055759 tempest-VolumesSnapshotsTestJSON-21055759-project] Calling method '.version_select at 0x7f75fcd39ca0>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:11:40.987238 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-0fb09457-fca7-4507-a7c0-f99e32df0e92 tempest-VolumesSnapshotsTestJSON-21055759 tempest-VolumesSnapshotsTestJSON-21055759-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots/0cda01de-5766-4ef8-8cfc-b8549c1b7b35" status: 200 len: 287 microversion: 2.1 time: 0.035349 Aug 07 05:11:40.987836 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 741/1441] 10.222.0.35 () {58 vars in 1251 bytes} [Sat Aug 7 05:11:40 2021] GET /compute/v2.1/os-snapshots/0cda01de-5766-4ef8-8cfc-b8549c1b7b35 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 05:11:40.997203 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-8cb25c2c-43a4-466d-a221-16daf354e1e3 tempest-VolumesSnapshotsTestJSON-21055759 tempest-VolumesSnapshotsTestJSON-21055759-project] Calling method '.version_select at 0x7f75f9cad790>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:11:41.025838 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-8cb25c2c-43a4-466d-a221-16daf354e1e3 tempest-VolumesSnapshotsTestJSON-21055759 tempest-VolumesSnapshotsTestJSON-21055759-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.032177 Aug 07 05:11:41.026395 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 701/1442] 10.222.0.35 () {58 vars in 1140 bytes} [Sat Aug 7 05:11:40 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 05:11:41.036734 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-537b578d-84bd-4024-89e4-96a3c7dfb561 tempest-VolumesSnapshotsTestJSON-21055759 tempest-VolumesSnapshotsTestJSON-21055759-project] Calling method '.version_select at 0x7f75fcda3af0>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:11:41.064301 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-537b578d-84bd-4024-89e4-96a3c7dfb561 tempest-VolumesSnapshotsTestJSON-21055759 tempest-VolumesSnapshotsTestJSON-21055759-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots/0cda01de-5766-4ef8-8cfc-b8549c1b7b35" status: 200 len: 287 microversion: 2.1 time: 0.031088 Aug 07 05:11:41.064863 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 742/1443] 10.222.0.35 () {58 vars in 1251 bytes} [Sat Aug 7 05:11:41 2021] GET /compute/v2.1/os-snapshots/0cda01de-5766-4ef8-8cfc-b8549c1b7b35 => generated 287 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 05:11:42.075786 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-bfa8126e-3747-40f8-8442-5360b341d538 tempest-VolumesSnapshotsTestJSON-21055759 tempest-VolumesSnapshotsTestJSON-21055759-project] Calling method '.version_select at 0x7f75ebebb280>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:11:42.107108 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-bfa8126e-3747-40f8-8442-5360b341d538 tempest-VolumesSnapshotsTestJSON-21055759 tempest-VolumesSnapshotsTestJSON-21055759-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots/0cda01de-5766-4ef8-8cfc-b8549c1b7b35" status: 200 len: 287 microversion: 2.1 time: 0.035018 Aug 07 05:11:42.107674 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 702/1444] 10.222.0.35 () {58 vars in 1251 bytes} [Sat Aug 7 05:11:42 2021] GET /compute/v2.1/os-snapshots/0cda01de-5766-4ef8-8cfc-b8549c1b7b35 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 05:11:43.118643 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-d912e7ab-f4e1-493e-85c0-75c4e998311e tempest-VolumesSnapshotsTestJSON-21055759 tempest-VolumesSnapshotsTestJSON-21055759-project] Calling method '.version_select at 0x7f75fcd2f790>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:11:43.147196 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-d912e7ab-f4e1-493e-85c0-75c4e998311e tempest-VolumesSnapshotsTestJSON-21055759 tempest-VolumesSnapshotsTestJSON-21055759-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots/0cda01de-5766-4ef8-8cfc-b8549c1b7b35" status: 200 len: 287 microversion: 2.1 time: 0.032168 Aug 07 05:11:43.147746 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 743/1445] 10.222.0.35 () {58 vars in 1251 bytes} [Sat Aug 7 05:11:43 2021] GET /compute/v2.1/os-snapshots/0cda01de-5766-4ef8-8cfc-b8549c1b7b35 => generated 287 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 05:11:44.158799 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-697119bd-ba7e-4da3-a042-ffd32bdfdc00 tempest-VolumesSnapshotsTestJSON-21055759 tempest-VolumesSnapshotsTestJSON-21055759-project] Calling method '.version_select at 0x7f75ebebb790>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:11:44.186269 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-697119bd-ba7e-4da3-a042-ffd32bdfdc00 tempest-VolumesSnapshotsTestJSON-21055759 tempest-VolumesSnapshotsTestJSON-21055759-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots/0cda01de-5766-4ef8-8cfc-b8549c1b7b35" status: 200 len: 287 microversion: 2.1 time: 0.031377 Aug 07 05:11:44.187306 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 703/1446] 10.222.0.35 () {58 vars in 1251 bytes} [Sat Aug 7 05:11:44 2021] GET /compute/v2.1/os-snapshots/0cda01de-5766-4ef8-8cfc-b8549c1b7b35 => generated 287 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 05:11:45.198247 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-a29a996d-68ba-4fd6-8f14-a31e2fd3f801 tempest-VolumesSnapshotsTestJSON-21055759 tempest-VolumesSnapshotsTestJSON-21055759-project] Calling method '.version_select at 0x7f75fcd39790>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:11:45.227214 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-a29a996d-68ba-4fd6-8f14-a31e2fd3f801 tempest-VolumesSnapshotsTestJSON-21055759 tempest-VolumesSnapshotsTestJSON-21055759-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots/0cda01de-5766-4ef8-8cfc-b8549c1b7b35" status: 200 len: 288 microversion: 2.1 time: 0.032588 Aug 07 05:11:45.227839 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 744/1447] 10.222.0.35 () {58 vars in 1251 bytes} [Sat Aug 7 05:11:45 2021] GET /compute/v2.1/os-snapshots/0cda01de-5766-4ef8-8cfc-b8549c1b7b35 => generated 288 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 05:11:45.238047 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-6e3d0265-cb5c-4358-b2a5-c5b8d0722c5f tempest-VolumesSnapshotsTestJSON-21055759 tempest-VolumesSnapshotsTestJSON-21055759-project] Calling method '.version_select at 0x7f75f9cade50>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:11:45.290583 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-6e3d0265-cb5c-4358-b2a5-c5b8d0722c5f tempest-VolumesSnapshotsTestJSON-21055759 tempest-VolumesSnapshotsTestJSON-21055759-project] 10.222.0.35 "DELETE /compute/v2.1/os-snapshots/0cda01de-5766-4ef8-8cfc-b8549c1b7b35" status: 202 len: 0 microversion: 2.1 time: 0.056394 Aug 07 05:11:45.291717 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 704/1448] 10.222.0.35 () {58 vars in 1254 bytes} [Sat Aug 7 05:11:45 2021] DELETE /compute/v2.1/os-snapshots/0cda01de-5766-4ef8-8cfc-b8549c1b7b35 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:11:45.299800 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-5e5e30a2-90da-4920-9329-68bb77e5214f tempest-VolumesSnapshotsTestJSON-21055759 tempest-VolumesSnapshotsTestJSON-21055759-project] Calling method '.version_select at 0x7f75fcda0550>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:11:45.329543 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-5e5e30a2-90da-4920-9329-68bb77e5214f tempest-VolumesSnapshotsTestJSON-21055759 tempest-VolumesSnapshotsTestJSON-21055759-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots/0cda01de-5766-4ef8-8cfc-b8549c1b7b35" status: 200 len: 287 microversion: 2.1 time: 0.033528 Aug 07 05:11:45.330214 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 745/1449] 10.222.0.35 () {58 vars in 1251 bytes} [Sat Aug 7 05:11:45 2021] GET /compute/v2.1/os-snapshots/0cda01de-5766-4ef8-8cfc-b8549c1b7b35 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 05:11:46.341363 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-4f080c75-6000-4976-9177-2ff6ab223a82 tempest-VolumesSnapshotsTestJSON-21055759 tempest-VolumesSnapshotsTestJSON-21055759-project] Calling method '.version_select at 0x7f75ebf261f0>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:11:46.366088 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.wsgi [None req-4f080c75-6000-4976-9177-2ff6ab223a82 tempest-VolumesSnapshotsTestJSON-21055759 tempest-VolumesSnapshotsTestJSON-21055759-project] HTTP exception thrown: Snapshot 0cda01de-5766-4ef8-8cfc-b8549c1b7b35 could not be found. Aug 07 05:11:46.366670 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-4f080c75-6000-4976-9177-2ff6ab223a82 tempest-VolumesSnapshotsTestJSON-21055759 tempest-VolumesSnapshotsTestJSON-21055759-project] Returning 404 to user: Snapshot 0cda01de-5766-4ef8-8cfc-b8549c1b7b35 could not be found. {{(pid=107485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 07 05:11:46.367495 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-4f080c75-6000-4976-9177-2ff6ab223a82 tempest-VolumesSnapshotsTestJSON-21055759 tempest-VolumesSnapshotsTestJSON-21055759-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots/0cda01de-5766-4ef8-8cfc-b8549c1b7b35" status: 404 len: 111 microversion: 2.1 time: 0.029852 Aug 07 05:11:46.368004 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 705/1450] 10.222.0.35 () {58 vars in 1251 bytes} [Sat Aug 7 05:11:46 2021] GET /compute/v2.1/os-snapshots/0cda01de-5766-4ef8-8cfc-b8549c1b7b35 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 05:11:46.375751 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-e0dcf030-4563-4241-a0f2-dec1201d26ad tempest-VolumesSnapshotsTestJSON-21055759 tempest-VolumesSnapshotsTestJSON-21055759-project] Calling method '.version_select at 0x7f75fcdba8b0>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:11:46.431304 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-e0dcf030-4563-4241-a0f2-dec1201d26ad tempest-VolumesSnapshotsTestJSON-21055759 tempest-VolumesSnapshotsTestJSON-21055759-project] 10.222.0.35 "DELETE /compute/v2.1/os-volumes/b8e77ec5-e9a2-438f-b3b7-1a5e4cd0a1d2" status: 202 len: 0 microversion: 2.1 time: 0.059118 Aug 07 05:11:46.431975 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 746/1451] 10.222.0.35 () {58 vars in 1248 bytes} [Sat Aug 7 05:11:46 2021] DELETE /compute/v2.1/os-volumes/b8e77ec5-e9a2-438f-b3b7-1a5e4cd0a1d2 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:11:46.440287 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-994a40c2-56ce-47c7-995e-522b69beb3d3 tempest-VolumesSnapshotsTestJSON-21055759 tempest-VolumesSnapshotsTestJSON-21055759-project] Calling method '.version_select at 0x7f75ebebbf70>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:11:46.490262 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-994a40c2-56ce-47c7-995e-522b69beb3d3 tempest-VolumesSnapshotsTestJSON-21055759 tempest-VolumesSnapshotsTestJSON-21055759-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/b8e77ec5-e9a2-438f-b3b7-1a5e4cd0a1d2" status: 200 len: 344 microversion: 2.1 time: 0.053870 Aug 07 05:11:46.490815 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 706/1452] 10.222.0.35 () {58 vars in 1245 bytes} [Sat Aug 7 05:11:46 2021] GET /compute/v2.1/os-volumes/b8e77ec5-e9a2-438f-b3b7-1a5e4cd0a1d2 => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 05:11:47.502575 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-ab8ab2c0-00f6-4d06-918e-95618a796d87 tempest-VolumesSnapshotsTestJSON-21055759 tempest-VolumesSnapshotsTestJSON-21055759-project] Calling method '.version_select at 0x7f75fcda03a0>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:11:47.528230 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.wsgi [None req-ab8ab2c0-00f6-4d06-918e-95618a796d87 tempest-VolumesSnapshotsTestJSON-21055759 tempest-VolumesSnapshotsTestJSON-21055759-project] HTTP exception thrown: Volume b8e77ec5-e9a2-438f-b3b7-1a5e4cd0a1d2 could not be found. Aug 07 05:11:47.528835 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-ab8ab2c0-00f6-4d06-918e-95618a796d87 tempest-VolumesSnapshotsTestJSON-21055759 tempest-VolumesSnapshotsTestJSON-21055759-project] Returning 404 to user: Volume b8e77ec5-e9a2-438f-b3b7-1a5e4cd0a1d2 could not be found. {{(pid=107486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 07 05:11:47.529639 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-ab8ab2c0-00f6-4d06-918e-95618a796d87 tempest-VolumesSnapshotsTestJSON-21055759 tempest-VolumesSnapshotsTestJSON-21055759-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/b8e77ec5-e9a2-438f-b3b7-1a5e4cd0a1d2" status: 404 len: 109 microversion: 2.1 time: 0.030897 Aug 07 05:11:47.530168 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 747/1453] 10.222.0.35 () {58 vars in 1245 bytes} [Sat Aug 7 05:11:47 2021] GET /compute/v2.1/os-volumes/b8e77ec5-e9a2-438f-b3b7-1a5e4cd0a1d2 => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 05:11:47.543752 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-53162196-87c0-4f2b-9de4-fe26cf03bad6 tempest-VolumesSnapshotsTestJSON-21055759 tempest-VolumesSnapshotsTestJSON-21055759-project] Calling method '.version_select at 0x7f75ebebb5e0>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:11:47.570848 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.wsgi [None req-53162196-87c0-4f2b-9de4-fe26cf03bad6 tempest-VolumesSnapshotsTestJSON-21055759 tempest-VolumesSnapshotsTestJSON-21055759-project] HTTP exception thrown: Volume b8e77ec5-e9a2-438f-b3b7-1a5e4cd0a1d2 could not be found. Aug 07 05:11:47.571434 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-53162196-87c0-4f2b-9de4-fe26cf03bad6 tempest-VolumesSnapshotsTestJSON-21055759 tempest-VolumesSnapshotsTestJSON-21055759-project] Returning 404 to user: Volume b8e77ec5-e9a2-438f-b3b7-1a5e4cd0a1d2 could not be found. {{(pid=107485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 07 05:11:47.572238 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-53162196-87c0-4f2b-9de4-fe26cf03bad6 tempest-VolumesSnapshotsTestJSON-21055759 tempest-VolumesSnapshotsTestJSON-21055759-project] 10.222.0.35 "DELETE /compute/v2.1/os-volumes/b8e77ec5-e9a2-438f-b3b7-1a5e4cd0a1d2" status: 404 len: 109 microversion: 2.1 time: 0.032131 Aug 07 05:11:47.572747 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 707/1454] 10.222.0.35 () {58 vars in 1248 bytes} [Sat Aug 7 05:11:47 2021] DELETE /compute/v2.1/os-volumes/b8e77ec5-e9a2-438f-b3b7-1a5e4cd0a1d2 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 05:11:47.581381 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-b1fe6322-f4c9-4c10-8a03-dfc990be78cb tempest-VolumesSnapshotsTestJSON-21055759 tempest-VolumesSnapshotsTestJSON-21055759-project] Calling method '.version_select at 0x7f75ebf8e4c0>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:11:47.607059 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.wsgi [None req-b1fe6322-f4c9-4c10-8a03-dfc990be78cb tempest-VolumesSnapshotsTestJSON-21055759 tempest-VolumesSnapshotsTestJSON-21055759-project] HTTP exception thrown: Volume b8e77ec5-e9a2-438f-b3b7-1a5e4cd0a1d2 could not be found. Aug 07 05:11:47.607682 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-b1fe6322-f4c9-4c10-8a03-dfc990be78cb tempest-VolumesSnapshotsTestJSON-21055759 tempest-VolumesSnapshotsTestJSON-21055759-project] Returning 404 to user: Volume b8e77ec5-e9a2-438f-b3b7-1a5e4cd0a1d2 could not be found. {{(pid=107486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 07 05:11:47.608498 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-b1fe6322-f4c9-4c10-8a03-dfc990be78cb tempest-VolumesSnapshotsTestJSON-21055759 tempest-VolumesSnapshotsTestJSON-21055759-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/b8e77ec5-e9a2-438f-b3b7-1a5e4cd0a1d2" status: 404 len: 109 microversion: 2.1 time: 0.031891 Aug 07 05:11:47.609068 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 748/1455] 10.222.0.35 () {58 vars in 1245 bytes} [Sat Aug 7 05:11:47 2021] GET /compute/v2.1/os-volumes/b8e77ec5-e9a2-438f-b3b7-1a5e4cd0a1d2 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 05:12:43.994760 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 05:12:43.996000 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: Sat Aug 7 05:12:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 05:12:56.216909 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-da9c470e-ee6f-4bd4-9fbc-e31a3bf0714d tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Action: 'create', calling method: .version_select at 0x7f75ebebbf70>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1066780467"}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:12:56.233904 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.quota [None req-da9c470e-ee6f-4bd4-9fbc-e31a3bf0714d tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Getting quotas for project 290f41dfdc1e4e1aab41ccaae7afc9b1. Resources: {'key_pairs'} {{(pid=107485) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 07 05:12:56.237623 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.quota [None req-da9c470e-ee6f-4bd4-9fbc-e31a3bf0714d tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Getting quotas for user 7ad5c033f0d44534932d86c95fbff8dd and project 290f41dfdc1e4e1aab41ccaae7afc9b1. Resources: {'key_pairs'} {{(pid=107485) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 07 05:12:56.406635 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.quota [None req-da9c470e-ee6f-4bd4-9fbc-e31a3bf0714d tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Getting quotas for project 290f41dfdc1e4e1aab41ccaae7afc9b1. Resources: {'key_pairs'} {{(pid=107485) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 07 05:12:56.410067 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.quota [None req-da9c470e-ee6f-4bd4-9fbc-e31a3bf0714d tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Getting quotas for user 7ad5c033f0d44534932d86c95fbff8dd and project 290f41dfdc1e4e1aab41ccaae7afc9b1. Resources: {'key_pairs'} {{(pid=107485) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 07 05:12:56.422924 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-da9c470e-ee6f-4bd4-9fbc-e31a3bf0714d tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.211260 Aug 07 05:12:56.423497 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 708/1456] 10.222.0.35 () {60 vars in 1158 bytes} [Sat Aug 7 05:12:56 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:12:56.471770 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-08c213b2-a46f-4c7c-a21a-868ac8052bd2 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1117745252", "imageRef": "86fe7c8d-7d23-46ff-945f-b94ac7c43aee", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1066780467", "networks": [{"uuid": "c5854fb3-29c8-468c-9e51-121b910b816e"}]}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:12:56.521780 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.network.neutron [None req-08c213b2-a46f-4c7c-a21a-868ac8052bd2 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] validate_networks() for [('c5854fb3-29c8-468c-9e51-121b910b816e', None, None, None)] {{(pid=107486) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 07 05:12:56.979865 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.virt.hardware [None req-08c213b2-a46f-4c7c-a21a-868ac8052bd2 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Flavor limits 0:0:0 {{(pid=107486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 05:12:56.980308 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.virt.hardware [None req-08c213b2-a46f-4c7c-a21a-868ac8052bd2 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Image limits 0:0:0 {{(pid=107486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 05:12:56.980814 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.virt.hardware [None req-08c213b2-a46f-4c7c-a21a-868ac8052bd2 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Flavor pref 0:0:0 {{(pid=107486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 05:12:56.981229 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.virt.hardware [None req-08c213b2-a46f-4c7c-a21a-868ac8052bd2 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Image pref 0:0:0 {{(pid=107486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 05:12:56.981649 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.virt.hardware [None req-08c213b2-a46f-4c7c-a21a-868ac8052bd2 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 05:12:56.990059 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-08c213b2-a46f-4c7c-a21a-868ac8052bd2 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:12:56.990499 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-08c213b2-a46f-4c7c-a21a-868ac8052bd2 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:12:56.991285 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-08c213b2-a46f-4c7c-a21a-868ac8052bd2 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:12:56.991707 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-08c213b2-a46f-4c7c-a21a-868ac8052bd2 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:12:57.007240 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.quota [None req-08c213b2-a46f-4c7c-a21a-868ac8052bd2 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Getting quotas for project 290f41dfdc1e4e1aab41ccaae7afc9b1. Resources: {'ram', 'cores', 'instances'} {{(pid=107486) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 07 05:12:57.011278 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.quota [None req-08c213b2-a46f-4c7c-a21a-868ac8052bd2 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Getting quotas for user 7ad5c033f0d44534932d86c95fbff8dd and project 290f41dfdc1e4e1aab41ccaae7afc9b1. Resources: {'ram', 'cores', 'instances'} {{(pid=107486) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 07 05:12:57.021552 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-08c213b2-a46f-4c7c-a21a-868ac8052bd2 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Going to run 1 instances... {{(pid=107486) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 07 05:12:57.024291 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-08c213b2-a46f-4c7c-a21a-868ac8052bd2 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] [instance: 59387c5b-f226-41d5-abfd-f64f7d3d2da7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='86fe7c8d-7d23-46ff-945f-b94ac7c43aee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107486) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 07 05:12:57.072413 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-08c213b2-a46f-4c7c-a21a-868ac8052bd2 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.605613 Aug 07 05:12:57.073069 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 749/1457] 10.222.0.35 () {60 vars in 1147 bytes} [Sat Aug 7 05:12:56 2021] POST /compute/v2.1/servers => generated 380 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 05:12:57.083014 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-82d56cb8-c548-4fbb-a5da-7610d7a3203d tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:12:57.083911 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-82d56cb8-c548-4fbb-a5da-7610d7a3203d tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] [instance: 59387c5b-f226-41d5-abfd-f64f7d3d2da7] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:12:57.135267 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-82d56cb8-c548-4fbb-a5da-7610d7a3203d tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad5c033f0d44534932d86c95fbff8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f41dfdc1e4e1aab41ccaae7afc9b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:12:57.142195 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-82d56cb8-c548-4fbb-a5da-7610d7a3203d tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] 10.222.0.35 "GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7" status: 200 len: 1259 microversion: 2.1 time: 0.063290 Aug 07 05:12:57.142739 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 709/1458] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:12:57 2021] GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7 => generated 1259 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:12:58.159000 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-8442d7a6-9190-4d69-9e43-64c4ca8899df tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:12:58.159606 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-8442d7a6-9190-4d69-9e43-64c4ca8899df tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] [instance: 59387c5b-f226-41d5-abfd-f64f7d3d2da7] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:12:58.210238 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-8442d7a6-9190-4d69-9e43-64c4ca8899df tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad5c033f0d44534932d86c95fbff8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f41dfdc1e4e1aab41ccaae7afc9b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:12:58.218305 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-8442d7a6-9190-4d69-9e43-64c4ca8899df tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] 10.222.0.35 "GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7" status: 200 len: 1259 microversion: 2.1 time: 0.062862 Aug 07 05:12:58.218863 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 750/1459] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:12:58 2021] GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7 => generated 1259 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:12:59.235001 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-5f418df6-3727-4768-836c-fd62bc95182a tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:12:59.235610 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-5f418df6-3727-4768-836c-fd62bc95182a tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] [instance: 59387c5b-f226-41d5-abfd-f64f7d3d2da7] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:12:59.284722 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-5f418df6-3727-4768-836c-fd62bc95182a tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad5c033f0d44534932d86c95fbff8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f41dfdc1e4e1aab41ccaae7afc9b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:12:59.291705 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-5f418df6-3727-4768-836c-fd62bc95182a tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] 10.222.0.35 "GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7" status: 200 len: 1259 microversion: 2.1 time: 0.060371 Aug 07 05:12:59.292250 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 710/1460] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:12:59 2021] GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7 => generated 1259 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:13:00.308590 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-4fbfea96-327d-4a90-8bb9-c158483801a8 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:13:00.309203 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-4fbfea96-327d-4a90-8bb9-c158483801a8 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] [instance: 59387c5b-f226-41d5-abfd-f64f7d3d2da7] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:13:00.359298 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-4fbfea96-327d-4a90-8bb9-c158483801a8 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad5c033f0d44534932d86c95fbff8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f41dfdc1e4e1aab41ccaae7afc9b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:13:00.365628 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-4fbfea96-327d-4a90-8bb9-c158483801a8 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] 10.222.0.35 "GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7" status: 200 len: 1259 microversion: 2.1 time: 0.060972 Aug 07 05:13:00.366178 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 751/1461] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:13:00 2021] GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7 => generated 1259 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:13:01.381871 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-7459a509-4c68-4ab1-99e7-8c0a03af561a tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:13:01.382481 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-7459a509-4c68-4ab1-99e7-8c0a03af561a tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] [instance: 59387c5b-f226-41d5-abfd-f64f7d3d2da7] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:13:01.388393 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7459a509-4c68-4ab1-99e7-8c0a03af561a tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:13:01.388858 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7459a509-4c68-4ab1-99e7-8c0a03af561a tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:13:01.389609 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7459a509-4c68-4ab1-99e7-8c0a03af561a tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:13:01.390035 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-7459a509-4c68-4ab1-99e7-8c0a03af561a tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:13:01.447090 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-7459a509-4c68-4ab1-99e7-8c0a03af561a tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad5c033f0d44534932d86c95fbff8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f41dfdc1e4e1aab41ccaae7afc9b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:13:01.454025 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-7459a509-4c68-4ab1-99e7-8c0a03af561a tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] 10.222.0.35 "GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7" status: 200 len: 1263 microversion: 2.1 time: 0.075833 Aug 07 05:13:01.454573 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 711/1462] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:13:01 2021] GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7 => generated 1263 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:13:02.471467 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-3e78a0a5-33a9-4aa8-8cb9-abe250b9e9ea tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:13:02.472194 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-3e78a0a5-33a9-4aa8-8cb9-abe250b9e9ea tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] [instance: 59387c5b-f226-41d5-abfd-f64f7d3d2da7] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:13:02.478621 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3e78a0a5-33a9-4aa8-8cb9-abe250b9e9ea tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:13:02.479067 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3e78a0a5-33a9-4aa8-8cb9-abe250b9e9ea tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:13:02.479928 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3e78a0a5-33a9-4aa8-8cb9-abe250b9e9ea tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:13:02.480362 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-3e78a0a5-33a9-4aa8-8cb9-abe250b9e9ea tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:13:02.549907 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-3e78a0a5-33a9-4aa8-8cb9-abe250b9e9ea tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad5c033f0d44534932d86c95fbff8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f41dfdc1e4e1aab41ccaae7afc9b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:13:02.558338 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-3e78a0a5-33a9-4aa8-8cb9-abe250b9e9ea tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] 10.222.0.35 "GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7" status: 200 len: 1317 microversion: 2.1 time: 0.090478 Aug 07 05:13:02.564105 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 752/1463] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:13:02 2021] GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7 => generated 1317 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:13:03.576203 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-0e2598aa-c762-4ef9-99ea-1da721f0e390 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:13:03.576863 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-0e2598aa-c762-4ef9-99ea-1da721f0e390 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] [instance: 59387c5b-f226-41d5-abfd-f64f7d3d2da7] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:13:03.583860 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0e2598aa-c762-4ef9-99ea-1da721f0e390 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:13:03.584310 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0e2598aa-c762-4ef9-99ea-1da721f0e390 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:13:03.585266 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0e2598aa-c762-4ef9-99ea-1da721f0e390 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:13:03.585706 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-0e2598aa-c762-4ef9-99ea-1da721f0e390 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:13:03.709907 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-0e2598aa-c762-4ef9-99ea-1da721f0e390 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad5c033f0d44534932d86c95fbff8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f41dfdc1e4e1aab41ccaae7afc9b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:13:03.717354 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-0e2598aa-c762-4ef9-99ea-1da721f0e390 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] 10.222.0.35 "GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7" status: 200 len: 1359 microversion: 2.1 time: 0.145814 Aug 07 05:13:03.717927 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 712/1464] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:13:03 2021] GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7 => generated 1359 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:13:04.734010 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-4625e5eb-47aa-4a24-999b-6db05e6f6853 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:13:04.734624 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-4625e5eb-47aa-4a24-999b-6db05e6f6853 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] [instance: 59387c5b-f226-41d5-abfd-f64f7d3d2da7] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:13:04.740646 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4625e5eb-47aa-4a24-999b-6db05e6f6853 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:13:04.741134 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4625e5eb-47aa-4a24-999b-6db05e6f6853 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:13:04.741901 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4625e5eb-47aa-4a24-999b-6db05e6f6853 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:13:04.742334 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4625e5eb-47aa-4a24-999b-6db05e6f6853 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:13:04.877010 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-4625e5eb-47aa-4a24-999b-6db05e6f6853 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad5c033f0d44534932d86c95fbff8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f41dfdc1e4e1aab41ccaae7afc9b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:13:04.885608 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-4625e5eb-47aa-4a24-999b-6db05e6f6853 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] 10.222.0.35 "GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7" status: 200 len: 1359 microversion: 2.1 time: 0.155221 Aug 07 05:13:04.886163 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 753/1465] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:13:04 2021] GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:13:05.902949 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-f6ae33bb-76f1-4fd4-bd38-99e581372f32 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:13:05.903572 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-f6ae33bb-76f1-4fd4-bd38-99e581372f32 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] [instance: 59387c5b-f226-41d5-abfd-f64f7d3d2da7] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:13:05.910534 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f6ae33bb-76f1-4fd4-bd38-99e581372f32 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:13:05.911080 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f6ae33bb-76f1-4fd4-bd38-99e581372f32 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:13:05.912180 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f6ae33bb-76f1-4fd4-bd38-99e581372f32 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:13:05.912610 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f6ae33bb-76f1-4fd4-bd38-99e581372f32 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:13:06.039571 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-f6ae33bb-76f1-4fd4-bd38-99e581372f32 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad5c033f0d44534932d86c95fbff8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f41dfdc1e4e1aab41ccaae7afc9b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:13:06.048553 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-f6ae33bb-76f1-4fd4-bd38-99e581372f32 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] 10.222.0.35 "GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7" status: 200 len: 1359 microversion: 2.1 time: 0.149887 Aug 07 05:13:06.049197 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 713/1466] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:13:05 2021] GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:13:07.065420 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-8439ee5a-170a-4df8-b5f6-1a9c17bc85f4 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:13:07.065966 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-8439ee5a-170a-4df8-b5f6-1a9c17bc85f4 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] [instance: 59387c5b-f226-41d5-abfd-f64f7d3d2da7] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:13:07.071943 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8439ee5a-170a-4df8-b5f6-1a9c17bc85f4 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:13:07.072385 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8439ee5a-170a-4df8-b5f6-1a9c17bc85f4 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:13:07.073635 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8439ee5a-170a-4df8-b5f6-1a9c17bc85f4 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:13:07.074080 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-8439ee5a-170a-4df8-b5f6-1a9c17bc85f4 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:13:07.206146 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-8439ee5a-170a-4df8-b5f6-1a9c17bc85f4 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad5c033f0d44534932d86c95fbff8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f41dfdc1e4e1aab41ccaae7afc9b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:13:07.214415 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-8439ee5a-170a-4df8-b5f6-1a9c17bc85f4 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] 10.222.0.35 "GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7" status: 200 len: 1359 microversion: 2.1 time: 0.152807 Aug 07 05:13:07.215068 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 754/1467] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:13:07 2021] GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:13:08.232088 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-39e6ac66-2a26-4f3b-a6e0-f17d241d0d19 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:13:08.232752 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-39e6ac66-2a26-4f3b-a6e0-f17d241d0d19 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] [instance: 59387c5b-f226-41d5-abfd-f64f7d3d2da7] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:13:08.238735 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-39e6ac66-2a26-4f3b-a6e0-f17d241d0d19 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:13:08.239180 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-39e6ac66-2a26-4f3b-a6e0-f17d241d0d19 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:13:08.239954 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-39e6ac66-2a26-4f3b-a6e0-f17d241d0d19 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:13:08.240387 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-39e6ac66-2a26-4f3b-a6e0-f17d241d0d19 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:13:08.363768 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-39e6ac66-2a26-4f3b-a6e0-f17d241d0d19 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad5c033f0d44534932d86c95fbff8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f41dfdc1e4e1aab41ccaae7afc9b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:13:08.372388 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-39e6ac66-2a26-4f3b-a6e0-f17d241d0d19 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] 10.222.0.35 "GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7" status: 200 len: 1359 microversion: 2.1 time: 0.144482 Aug 07 05:13:08.373332 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 714/1468] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:13:08 2021] GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7 => generated 1359 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:13:09.391422 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-ccf6f193-48f7-4ff8-998d-90a3b14360ef tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:13:09.392116 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-ccf6f193-48f7-4ff8-998d-90a3b14360ef tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] [instance: 59387c5b-f226-41d5-abfd-f64f7d3d2da7] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:13:09.398947 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ccf6f193-48f7-4ff8-998d-90a3b14360ef tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:13:09.399389 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ccf6f193-48f7-4ff8-998d-90a3b14360ef tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:13:09.400160 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ccf6f193-48f7-4ff8-998d-90a3b14360ef tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:13:09.401283 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-ccf6f193-48f7-4ff8-998d-90a3b14360ef tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:13:09.530960 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-ccf6f193-48f7-4ff8-998d-90a3b14360ef tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad5c033f0d44534932d86c95fbff8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f41dfdc1e4e1aab41ccaae7afc9b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:13:09.538522 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-ccf6f193-48f7-4ff8-998d-90a3b14360ef tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] 10.222.0.35 "GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7" status: 200 len: 1359 microversion: 2.1 time: 0.151776 Aug 07 05:13:09.539089 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 755/1469] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:13:09 2021] GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:13:10.554913 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-8995fade-0d8b-4d4a-96b7-50c820d2caec tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:13:10.555611 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-8995fade-0d8b-4d4a-96b7-50c820d2caec tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] [instance: 59387c5b-f226-41d5-abfd-f64f7d3d2da7] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:13:10.561788 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8995fade-0d8b-4d4a-96b7-50c820d2caec tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:13:10.562324 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8995fade-0d8b-4d4a-96b7-50c820d2caec tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:13:10.563155 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8995fade-0d8b-4d4a-96b7-50c820d2caec tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:13:10.563649 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8995fade-0d8b-4d4a-96b7-50c820d2caec tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:13:10.698673 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-8995fade-0d8b-4d4a-96b7-50c820d2caec tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad5c033f0d44534932d86c95fbff8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f41dfdc1e4e1aab41ccaae7afc9b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:13:10.706074 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-8995fade-0d8b-4d4a-96b7-50c820d2caec tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] 10.222.0.35 "GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7" status: 200 len: 1359 microversion: 2.1 time: 0.154821 Aug 07 05:13:10.706640 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 715/1470] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:13:10 2021] GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:13:11.724681 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-19a970da-9b34-4470-897b-cfb156700e5f tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:13:11.725315 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-19a970da-9b34-4470-897b-cfb156700e5f tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] [instance: 59387c5b-f226-41d5-abfd-f64f7d3d2da7] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:13:11.731738 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-19a970da-9b34-4470-897b-cfb156700e5f tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:13:11.732187 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-19a970da-9b34-4470-897b-cfb156700e5f tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:13:11.733005 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-19a970da-9b34-4470-897b-cfb156700e5f tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:13:11.733443 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-19a970da-9b34-4470-897b-cfb156700e5f tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:13:11.871441 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-19a970da-9b34-4470-897b-cfb156700e5f tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad5c033f0d44534932d86c95fbff8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f41dfdc1e4e1aab41ccaae7afc9b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:13:11.879548 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-19a970da-9b34-4470-897b-cfb156700e5f tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] 10.222.0.35 "GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7" status: 200 len: 1359 microversion: 2.1 time: 0.158451 Aug 07 05:13:11.880118 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 756/1471] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:13:11 2021] GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:13:12.896719 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-4d5475d8-0783-4a8d-8bda-e09f54e3938e tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:13:12.897347 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-4d5475d8-0783-4a8d-8bda-e09f54e3938e tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] [instance: 59387c5b-f226-41d5-abfd-f64f7d3d2da7] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:13:12.903924 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4d5475d8-0783-4a8d-8bda-e09f54e3938e tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:13:12.904365 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4d5475d8-0783-4a8d-8bda-e09f54e3938e tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:13:12.905158 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4d5475d8-0783-4a8d-8bda-e09f54e3938e tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:13:12.905594 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4d5475d8-0783-4a8d-8bda-e09f54e3938e tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:13:13.024662 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-4d5475d8-0783-4a8d-8bda-e09f54e3938e tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad5c033f0d44534932d86c95fbff8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f41dfdc1e4e1aab41ccaae7afc9b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:13:13.032541 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-4d5475d8-0783-4a8d-8bda-e09f54e3938e tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] 10.222.0.35 "GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7" status: 200 len: 1359 microversion: 2.1 time: 0.139681 Aug 07 05:13:13.033131 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 716/1472] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:13:12 2021] GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7 => generated 1359 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:13:14.048978 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-82a8de3c-ff3b-4f26-95aa-a3318f2b87f0 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:13:14.049552 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-82a8de3c-ff3b-4f26-95aa-a3318f2b87f0 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] [instance: 59387c5b-f226-41d5-abfd-f64f7d3d2da7] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:13:14.055306 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-82a8de3c-ff3b-4f26-95aa-a3318f2b87f0 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:13:14.055748 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-82a8de3c-ff3b-4f26-95aa-a3318f2b87f0 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:13:14.056529 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-82a8de3c-ff3b-4f26-95aa-a3318f2b87f0 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:13:14.056994 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-82a8de3c-ff3b-4f26-95aa-a3318f2b87f0 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:13:14.177063 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-82a8de3c-ff3b-4f26-95aa-a3318f2b87f0 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad5c033f0d44534932d86c95fbff8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f41dfdc1e4e1aab41ccaae7afc9b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:13:14.184994 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-82a8de3c-ff3b-4f26-95aa-a3318f2b87f0 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] 10.222.0.35 "GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7" status: 200 len: 1359 microversion: 2.1 time: 0.139727 Aug 07 05:13:14.185555 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 757/1473] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:13:14 2021] GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7 => generated 1359 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:13:15.202144 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-c2f8d5e8-c561-4769-a6ca-09bd5f716f3d tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:13:15.203016 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-c2f8d5e8-c561-4769-a6ca-09bd5f716f3d tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] [instance: 59387c5b-f226-41d5-abfd-f64f7d3d2da7] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:13:15.209250 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c2f8d5e8-c561-4769-a6ca-09bd5f716f3d tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:13:15.209700 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c2f8d5e8-c561-4769-a6ca-09bd5f716f3d tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:13:15.210492 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c2f8d5e8-c561-4769-a6ca-09bd5f716f3d tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:13:15.210930 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-c2f8d5e8-c561-4769-a6ca-09bd5f716f3d tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:13:15.396323 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [req-dab1c879-862d-48d2-8264-65a2d1a41dd8 req-3d715b4d-7c67-4ff2-8bbd-6a95b39e6a98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59387c5b-f226-41d5-abfd-f64f7d3d2da7", "tag": "51059a16-50f8-4560-ba4e-347c99d545d3"}]} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:13:15.404085 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 05:13:15.404085 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: warnings.warn(msg) Aug 07 05:13:15.414469 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-dab1c879-862d-48d2-8264-65a2d1a41dd8 req-3d715b4d-7c67-4ff2-8bbd-6a95b39e6a98 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:13:15.414913 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-dab1c879-862d-48d2-8264-65a2d1a41dd8 req-3d715b4d-7c67-4ff2-8bbd-6a95b39e6a98 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:13:15.426539 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.compute.server_external_events [req-dab1c879-862d-48d2-8264-65a2d1a41dd8 req-3d715b4d-7c67-4ff2-8bbd-6a95b39e6a98 service nova] Creating event network-changed:51059a16-50f8-4560-ba4e-347c99d545d3 for instance 59387c5b-f226-41d5-abfd-f64f7d3d2da7 on hv-cinder-80374 Aug 07 05:13:15.431787 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [req-dab1c879-862d-48d2-8264-65a2d1a41dd8 req-3d715b4d-7c67-4ff2-8bbd-6a95b39e6a98 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039352 Aug 07 05:13:15.433878 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 758/1474] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 05:13:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 05:13:15.446956 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-c2f8d5e8-c561-4769-a6ca-09bd5f716f3d tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad5c033f0d44534932d86c95fbff8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f41dfdc1e4e1aab41ccaae7afc9b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:13:15.455635 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-c2f8d5e8-c561-4769-a6ca-09bd5f716f3d tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] 10.222.0.35 "GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7" status: 200 len: 1359 microversion: 2.1 time: 0.257812 Aug 07 05:13:15.456200 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 717/1475] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:13:15 2021] GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7 => generated 1359 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:13:16.473125 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-aba3d795-eb86-49ea-9a2c-668ace8663ab tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:13:16.473848 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-aba3d795-eb86-49ea-9a2c-668ace8663ab tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] [instance: 59387c5b-f226-41d5-abfd-f64f7d3d2da7] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:13:16.480597 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-aba3d795-eb86-49ea-9a2c-668ace8663ab tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:13:16.481013 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-aba3d795-eb86-49ea-9a2c-668ace8663ab tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:13:16.481778 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-aba3d795-eb86-49ea-9a2c-668ace8663ab tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:13:16.482204 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-aba3d795-eb86-49ea-9a2c-668ace8663ab tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:13:16.606912 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-aba3d795-eb86-49ea-9a2c-668ace8663ab tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad5c033f0d44534932d86c95fbff8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f41dfdc1e4e1aab41ccaae7afc9b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:13:16.614266 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-aba3d795-eb86-49ea-9a2c-668ace8663ab tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] 10.222.0.35 "GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7" status: 200 len: 1359 microversion: 2.1 time: 0.145101 Aug 07 05:13:16.614828 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 759/1476] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:13:16 2021] GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7 => generated 1359 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:13:17.631058 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-8a3a8b0d-e3e3-40cc-9bd8-987508b30517 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:13:17.631670 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-8a3a8b0d-e3e3-40cc-9bd8-987508b30517 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] [instance: 59387c5b-f226-41d5-abfd-f64f7d3d2da7] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:13:17.637882 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8a3a8b0d-e3e3-40cc-9bd8-987508b30517 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:13:17.638321 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8a3a8b0d-e3e3-40cc-9bd8-987508b30517 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:13:17.639120 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8a3a8b0d-e3e3-40cc-9bd8-987508b30517 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:13:17.639551 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8a3a8b0d-e3e3-40cc-9bd8-987508b30517 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:13:17.760159 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-8a3a8b0d-e3e3-40cc-9bd8-987508b30517 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad5c033f0d44534932d86c95fbff8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f41dfdc1e4e1aab41ccaae7afc9b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:13:17.767653 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-8a3a8b0d-e3e3-40cc-9bd8-987508b30517 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] 10.222.0.35 "GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7" status: 200 len: 1359 microversion: 2.1 time: 0.140297 Aug 07 05:13:17.768199 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 718/1477] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:13:17 2021] GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7 => generated 1359 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:13:18.784969 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-f2772056-cb56-4d20-aedb-f14e76799e3d tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:13:18.785586 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-f2772056-cb56-4d20-aedb-f14e76799e3d tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] [instance: 59387c5b-f226-41d5-abfd-f64f7d3d2da7] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:13:18.791552 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f2772056-cb56-4d20-aedb-f14e76799e3d tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:13:18.792538 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f2772056-cb56-4d20-aedb-f14e76799e3d tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:13:18.793332 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f2772056-cb56-4d20-aedb-f14e76799e3d tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:13:18.793768 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f2772056-cb56-4d20-aedb-f14e76799e3d tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:13:18.910207 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-f2772056-cb56-4d20-aedb-f14e76799e3d tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad5c033f0d44534932d86c95fbff8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f41dfdc1e4e1aab41ccaae7afc9b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:13:18.917927 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-f2772056-cb56-4d20-aedb-f14e76799e3d tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] 10.222.0.35 "GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7" status: 200 len: 1359 microversion: 2.1 time: 0.136702 Aug 07 05:13:18.918484 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 760/1478] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:13:18 2021] GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7 => generated 1359 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:13:19.934054 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-b1ae46f0-69cd-4927-88b2-3f1cf8060b61 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:13:19.934666 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-b1ae46f0-69cd-4927-88b2-3f1cf8060b61 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] [instance: 59387c5b-f226-41d5-abfd-f64f7d3d2da7] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:13:19.940594 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b1ae46f0-69cd-4927-88b2-3f1cf8060b61 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:13:19.941074 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b1ae46f0-69cd-4927-88b2-3f1cf8060b61 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:13:19.941848 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b1ae46f0-69cd-4927-88b2-3f1cf8060b61 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:13:19.942281 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b1ae46f0-69cd-4927-88b2-3f1cf8060b61 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:13:20.059956 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-b1ae46f0-69cd-4927-88b2-3f1cf8060b61 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad5c033f0d44534932d86c95fbff8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f41dfdc1e4e1aab41ccaae7afc9b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:13:20.067229 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-b1ae46f0-69cd-4927-88b2-3f1cf8060b61 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] 10.222.0.35 "GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7" status: 200 len: 1359 microversion: 2.1 time: 0.137458 Aug 07 05:13:20.067799 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 719/1479] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:13:19 2021] GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7 => generated 1359 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:13:21.084825 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-143d835b-1a0c-401e-8d4f-24c6ba1efbfe tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:13:21.085437 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-143d835b-1a0c-401e-8d4f-24c6ba1efbfe tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] [instance: 59387c5b-f226-41d5-abfd-f64f7d3d2da7] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:13:21.091403 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-143d835b-1a0c-401e-8d4f-24c6ba1efbfe tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:13:21.091834 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-143d835b-1a0c-401e-8d4f-24c6ba1efbfe tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:13:21.092588 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-143d835b-1a0c-401e-8d4f-24c6ba1efbfe tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:13:21.093050 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-143d835b-1a0c-401e-8d4f-24c6ba1efbfe tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:13:21.211782 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-143d835b-1a0c-401e-8d4f-24c6ba1efbfe tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad5c033f0d44534932d86c95fbff8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f41dfdc1e4e1aab41ccaae7afc9b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:13:21.218988 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-143d835b-1a0c-401e-8d4f-24c6ba1efbfe tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] 10.222.0.35 "GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7" status: 200 len: 1359 microversion: 2.1 time: 0.138126 Aug 07 05:13:21.219547 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 761/1480] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:13:21 2021] GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7 => generated 1359 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:13:21.737974 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [req-be6ca959-e550-407e-8bf0-0f28c339f914 req-f7e50f6b-1d26-4910-900c-cc7fa4102c38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59387c5b-f226-41d5-abfd-f64f7d3d2da7", "name": "network-vif-plugged", "status": "completed", "tag": "51059a16-50f8-4560-ba4e-347c99d545d3"}]} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:13:21.739584 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 05:13:21.739584 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: warnings.warn(msg) Aug 07 05:13:21.746567 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-be6ca959-e550-407e-8bf0-0f28c339f914 req-f7e50f6b-1d26-4910-900c-cc7fa4102c38 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:13:21.747004 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-be6ca959-e550-407e-8bf0-0f28c339f914 req-f7e50f6b-1d26-4910-900c-cc7fa4102c38 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:13:21.758950 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.compute.server_external_events [req-be6ca959-e550-407e-8bf0-0f28c339f914 req-f7e50f6b-1d26-4910-900c-cc7fa4102c38 service nova] Creating event network-vif-plugged:51059a16-50f8-4560-ba4e-347c99d545d3 for instance 59387c5b-f226-41d5-abfd-f64f7d3d2da7 on hv-cinder-80374 Aug 07 05:13:21.764656 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [req-be6ca959-e550-407e-8bf0-0f28c339f914 req-f7e50f6b-1d26-4910-900c-cc7fa4102c38 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146618 Aug 07 05:13:21.765272 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 720/1481] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 05:13:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 05:13:22.235433 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-4c2fb014-7bfa-45aa-afb2-302a69b990cb tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:13:22.236022 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-4c2fb014-7bfa-45aa-afb2-302a69b990cb tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] [instance: 59387c5b-f226-41d5-abfd-f64f7d3d2da7] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:13:22.241986 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4c2fb014-7bfa-45aa-afb2-302a69b990cb tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:13:22.242424 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4c2fb014-7bfa-45aa-afb2-302a69b990cb tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:13:22.243181 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4c2fb014-7bfa-45aa-afb2-302a69b990cb tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:13:22.243605 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-4c2fb014-7bfa-45aa-afb2-302a69b990cb tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:13:22.363703 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-4c2fb014-7bfa-45aa-afb2-302a69b990cb tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad5c033f0d44534932d86c95fbff8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f41dfdc1e4e1aab41ccaae7afc9b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:13:22.371629 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-4c2fb014-7bfa-45aa-afb2-302a69b990cb tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] 10.222.0.35 "GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7" status: 200 len: 1359 microversion: 2.1 time: 0.139864 Aug 07 05:13:22.372183 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 762/1482] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:13:22 2021] GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7 => generated 1359 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:13:23.389099 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-bd20d425-6045-430b-94af-d45a1efa9643 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:13:23.389714 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-bd20d425-6045-430b-94af-d45a1efa9643 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] [instance: 59387c5b-f226-41d5-abfd-f64f7d3d2da7] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:13:23.396761 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-bd20d425-6045-430b-94af-d45a1efa9643 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:13:23.397241 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-bd20d425-6045-430b-94af-d45a1efa9643 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:13:23.398022 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-bd20d425-6045-430b-94af-d45a1efa9643 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:13:23.398656 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-bd20d425-6045-430b-94af-d45a1efa9643 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:13:23.526741 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-bd20d425-6045-430b-94af-d45a1efa9643 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad5c033f0d44534932d86c95fbff8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f41dfdc1e4e1aab41ccaae7afc9b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:13:23.534764 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-bd20d425-6045-430b-94af-d45a1efa9643 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] 10.222.0.35 "GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7" status: 200 len: 1549 microversion: 2.1 time: 0.150712 Aug 07 05:13:23.535327 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 721/1483] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:13:23 2021] GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7 => generated 1549 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:13:23.550324 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-edba70cd-fe23-48ec-83e5-68bb1567a2df tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:13:23.550921 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-edba70cd-fe23-48ec-83e5-68bb1567a2df tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] [instance: 59387c5b-f226-41d5-abfd-f64f7d3d2da7] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:13:23.556618 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-edba70cd-fe23-48ec-83e5-68bb1567a2df tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:13:23.557100 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-edba70cd-fe23-48ec-83e5-68bb1567a2df tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:13:23.557887 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-edba70cd-fe23-48ec-83e5-68bb1567a2df tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:13:23.558313 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-edba70cd-fe23-48ec-83e5-68bb1567a2df tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:13:23.676587 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-edba70cd-fe23-48ec-83e5-68bb1567a2df tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad5c033f0d44534932d86c95fbff8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f41dfdc1e4e1aab41ccaae7afc9b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:13:23.684598 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-edba70cd-fe23-48ec-83e5-68bb1567a2df tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] 10.222.0.35 "GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7" status: 200 len: 1549 microversion: 2.1 time: 0.137036 Aug 07 05:13:23.685123 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 763/1484] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:13:23 2021] GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7 => generated 1549 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 05:13:23.700228 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-4355f633-e3b4-4bc6-902a-a7e4b2651851 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:13:23.703463 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 05:13:23.703463 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: warnings.warn(msg) Aug 07 05:13:23.704429 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-4355f633-e3b4-4bc6-902a-a7e4b2651851 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7ad5c033f0d44534932d86c95fbff8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f41dfdc1e4e1aab41ccaae7afc9b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:13:23.705197 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-4355f633-e3b4-4bc6-902a-a7e4b2651851 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Searching by: {'deleted': False, 'project_id': '290f41dfdc1e4e1aab41ccaae7afc9b1'} {{(pid=107485) get_all /opt/stack/nova/nova/compute/api.py:2833}} Aug 07 05:13:23.711938 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4355f633-e3b4-4bc6-902a-a7e4b2651851 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:13:23.712379 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4355f633-e3b4-4bc6-902a-a7e4b2651851 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:13:23.713211 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4355f633-e3b4-4bc6-902a-a7e4b2651851 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:13:23.713641 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-4355f633-e3b4-4bc6-902a-a7e4b2651851 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:13:23.803862 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.multi_cell_list [None req-4355f633-e3b4-4bc6-902a-a7e4b2651851 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=107485) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Aug 07 05:13:23.898742 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-4355f633-e3b4-4bc6-902a-a7e4b2651851 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] 10.222.0.35 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.202654 Aug 07 05:13:23.899312 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 722/1485] 10.222.0.35 () {58 vars in 1125 bytes} [Sat Aug 7 05:13:23 2021] GET /compute/v2.1/servers => generated 343 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 05:13:23.909477 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-6e4d27ac-cd11-4c4e-8952-47f7c3915236 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:13:23.910093 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-6e4d27ac-cd11-4c4e-8952-47f7c3915236 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] [instance: 59387c5b-f226-41d5-abfd-f64f7d3d2da7] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:13:23.915960 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6e4d27ac-cd11-4c4e-8952-47f7c3915236 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:13:23.916405 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6e4d27ac-cd11-4c4e-8952-47f7c3915236 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:13:23.917215 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6e4d27ac-cd11-4c4e-8952-47f7c3915236 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:13:23.917655 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-6e4d27ac-cd11-4c4e-8952-47f7c3915236 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:13:24.034214 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-6e4d27ac-cd11-4c4e-8952-47f7c3915236 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad5c033f0d44534932d86c95fbff8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f41dfdc1e4e1aab41ccaae7afc9b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:13:24.041452 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-6e4d27ac-cd11-4c4e-8952-47f7c3915236 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] 10.222.0.35 "GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7" status: 200 len: 1549 microversion: 2.1 time: 0.135606 Aug 07 05:13:24.042013 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 764/1486] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:13:23 2021] GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7 => generated 1549 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:13:25.552496 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-2ddbfb4e-76ed-4c3b-80d6-cb41d807d1d6 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f457996f-8a27-4f1c-812c-dce13711a2d5"}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:13:25.553570 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-2ddbfb4e-76ed-4c3b-80d6-cb41d807d1d6 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] [instance: 59387c5b-f226-41d5-abfd-f64f7d3d2da7] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:13:25.559944 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2ddbfb4e-76ed-4c3b-80d6-cb41d807d1d6 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:13:25.560389 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2ddbfb4e-76ed-4c3b-80d6-cb41d807d1d6 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:13:25.561366 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2ddbfb4e-76ed-4c3b-80d6-cb41d807d1d6 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:13:25.561802 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-2ddbfb4e-76ed-4c3b-80d6-cb41d807d1d6 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:13:25.802026 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-2ddbfb4e-76ed-4c3b-80d6-cb41d807d1d6 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] 10.222.0.35 "POST /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253196 Aug 07 05:13:25.802618 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 723/1487] 10.222.0.35 () {60 vars in 1323 bytes} [Sat Aug 7 05:13:25 2021] POST /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 05:13:33.351514 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-f427d7bb-5e9a-4151-891c-a1b2094dfdd7 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:13:33.352133 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-f427d7bb-5e9a-4151-891c-a1b2094dfdd7 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] [instance: 59387c5b-f226-41d5-abfd-f64f7d3d2da7] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:13:33.358304 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f427d7bb-5e9a-4151-891c-a1b2094dfdd7 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:13:33.358756 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f427d7bb-5e9a-4151-891c-a1b2094dfdd7 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:13:33.359522 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f427d7bb-5e9a-4151-891c-a1b2094dfdd7 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:13:33.359959 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-f427d7bb-5e9a-4151-891c-a1b2094dfdd7 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:13:33.482705 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-f427d7bb-5e9a-4151-891c-a1b2094dfdd7 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad5c033f0d44534932d86c95fbff8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f41dfdc1e4e1aab41ccaae7afc9b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:13:33.490402 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-f427d7bb-5e9a-4151-891c-a1b2094dfdd7 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] 10.222.0.35 "GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7" status: 200 len: 1595 microversion: 2.1 time: 0.142502 Aug 07 05:13:33.490957 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 765/1488] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:13:33 2021] GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7 => generated 1595 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:13:35.080443 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [req-2f1db65f-8f80-4ce5-82ed-d7919484a860 req-aef50251-601b-4cd5-b5c1-71e93206bbeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59387c5b-f226-41d5-abfd-f64f7d3d2da7", "tag": "51059a16-50f8-4560-ba4e-347c99d545d3"}]} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:13:35.082007 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 05:13:35.082007 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: warnings.warn(msg) Aug 07 05:13:35.090280 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-2f1db65f-8f80-4ce5-82ed-d7919484a860 req-aef50251-601b-4cd5-b5c1-71e93206bbeb service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:13:35.090826 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-2f1db65f-8f80-4ce5-82ed-d7919484a860 req-aef50251-601b-4cd5-b5c1-71e93206bbeb service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:13:35.101285 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.compute.server_external_events [req-2f1db65f-8f80-4ce5-82ed-d7919484a860 req-aef50251-601b-4cd5-b5c1-71e93206bbeb service nova] Creating event network-changed:51059a16-50f8-4560-ba4e-347c99d545d3 for instance 59387c5b-f226-41d5-abfd-f64f7d3d2da7 on hv-cinder-80374 Aug 07 05:13:35.106613 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [req-2f1db65f-8f80-4ce5-82ed-d7919484a860 req-aef50251-601b-4cd5-b5c1-71e93206bbeb service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029941 Aug 07 05:13:35.107388 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 724/1489] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 05:13:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 05:13:36.066068 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-2adaa432-4e1b-4566-b11d-f616a562f450 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-721822200"}} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:13:36.066630 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-2adaa432-4e1b-4566-b11d-f616a562f450 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] [instance: 59387c5b-f226-41d5-abfd-f64f7d3d2da7] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:13:36.072646 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2adaa432-4e1b-4566-b11d-f616a562f450 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:13:36.073123 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2adaa432-4e1b-4566-b11d-f616a562f450 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:13:36.073911 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2adaa432-4e1b-4566-b11d-f616a562f450 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:13:36.074328 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-2adaa432-4e1b-4566-b11d-f616a562f450 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:13:36.194290 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.network.security_group_api [None req-2adaa432-4e1b-4566-b11d-f616a562f450 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Adding security group f1998bdd-a871-4c7b-8c07-da9180cd2379 to port 51059a16-50f8-4560-ba4e-347c99d545d3 Aug 07 05:13:36.534556 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-2adaa432-4e1b-4566-b11d-f616a562f450 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] 10.222.0.35 "POST /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7/action" status: 202 len: 0 microversion: 2.1 time: 0.472114 Aug 07 05:13:36.535718 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 766/1490] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:13:36 2021] POST /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7/action => generated 0 bytes in 474 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:13:36.544665 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-b0350acb-50d7-406d-8115-560c62c95898 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:13:36.545901 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-b0350acb-50d7-406d-8115-560c62c95898 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] [instance: 59387c5b-f226-41d5-abfd-f64f7d3d2da7] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:13:36.553746 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b0350acb-50d7-406d-8115-560c62c95898 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:13:36.554647 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b0350acb-50d7-406d-8115-560c62c95898 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:13:36.555652 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b0350acb-50d7-406d-8115-560c62c95898 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:13:36.556365 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-b0350acb-50d7-406d-8115-560c62c95898 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:13:36.701526 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-b0350acb-50d7-406d-8115-560c62c95898 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad5c033f0d44534932d86c95fbff8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f41dfdc1e4e1aab41ccaae7afc9b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:13:36.716700 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-b0350acb-50d7-406d-8115-560c62c95898 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] 10.222.0.35 "GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7" status: 200 len: 1760 microversion: 2.1 time: 0.176703 Aug 07 05:13:36.717322 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 725/1491] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:13:36 2021] GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7 => generated 1760 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:13:37.122319 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [req-aab0e46e-0d59-42f3-bd94-b3ceeea4c531 req-300b9c55-c9a1-4d6b-ae84-6e18d6e994a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59387c5b-f226-41d5-abfd-f64f7d3d2da7", "tag": "51059a16-50f8-4560-ba4e-347c99d545d3"}]} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:13:37.123973 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 05:13:37.123973 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: warnings.warn(msg) Aug 07 05:13:37.131651 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-aab0e46e-0d59-42f3-bd94-b3ceeea4c531 req-300b9c55-c9a1-4d6b-ae84-6e18d6e994a1 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:13:37.132345 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-aab0e46e-0d59-42f3-bd94-b3ceeea4c531 req-300b9c55-c9a1-4d6b-ae84-6e18d6e994a1 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:13:37.145044 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.compute.server_external_events [req-aab0e46e-0d59-42f3-bd94-b3ceeea4c531 req-300b9c55-c9a1-4d6b-ae84-6e18d6e994a1 service nova] Creating event network-changed:51059a16-50f8-4560-ba4e-347c99d545d3 for instance 59387c5b-f226-41d5-abfd-f64f7d3d2da7 on hv-cinder-80374 Aug 07 05:13:37.149929 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [req-aab0e46e-0d59-42f3-bd94-b3ceeea4c531 req-300b9c55-c9a1-4d6b-ae84-6e18d6e994a1 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032016 Aug 07 05:13:37.150521 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 767/1492] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 05:13:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 05:13:42.210207 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 05:13:42.210813 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: Sat Aug 7 05:13:42 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 05:14:37.292590 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-39ff8c04-cdcb-4679-ac3b-5d8b7ec32282 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:14:37.294350 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-39ff8c04-cdcb-4679-ac3b-5d8b7ec32282 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] [instance: 59387c5b-f226-41d5-abfd-f64f7d3d2da7] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:14:37.300176 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-39ff8c04-cdcb-4679-ac3b-5d8b7ec32282 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:14:37.300619 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-39ff8c04-cdcb-4679-ac3b-5d8b7ec32282 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:14:37.301411 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-39ff8c04-cdcb-4679-ac3b-5d8b7ec32282 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:14:37.301841 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-39ff8c04-cdcb-4679-ac3b-5d8b7ec32282 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:14:37.371036 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-39ff8c04-cdcb-4679-ac3b-5d8b7ec32282 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] 10.222.0.35 "POST /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7/action" status: 202 len: 0 microversion: 2.1 time: 0.082828 Aug 07 05:14:37.371763 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 726/1493] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:14:37 2021] POST /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:14:37.382200 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-22323184-8c8b-49be-a8ca-03badd084592 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:14:37.382896 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-22323184-8c8b-49be-a8ca-03badd084592 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] [instance: 59387c5b-f226-41d5-abfd-f64f7d3d2da7] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:14:37.389553 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-22323184-8c8b-49be-a8ca-03badd084592 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:14:37.390655 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-22323184-8c8b-49be-a8ca-03badd084592 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:14:37.391436 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-22323184-8c8b-49be-a8ca-03badd084592 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:14:37.392055 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-22323184-8c8b-49be-a8ca-03badd084592 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:14:37.573744 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-22323184-8c8b-49be-a8ca-03badd084592 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad5c033f0d44534932d86c95fbff8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f41dfdc1e4e1aab41ccaae7afc9b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:14:37.583095 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-22323184-8c8b-49be-a8ca-03badd084592 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] 10.222.0.35 "GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7" status: 200 len: 1752 microversion: 2.1 time: 0.206238 Aug 07 05:14:37.583659 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 768/1494] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:14:37 2021] GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7 => generated 1752 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:14:38.600640 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-583006b3-9f1b-4cb4-aea5-01968e49013e tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:14:38.601403 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-583006b3-9f1b-4cb4-aea5-01968e49013e tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] [instance: 59387c5b-f226-41d5-abfd-f64f7d3d2da7] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:14:38.607455 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-583006b3-9f1b-4cb4-aea5-01968e49013e tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:14:38.607902 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-583006b3-9f1b-4cb4-aea5-01968e49013e tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:14:38.608671 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-583006b3-9f1b-4cb4-aea5-01968e49013e tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:14:38.609147 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-583006b3-9f1b-4cb4-aea5-01968e49013e tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:14:38.782874 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-583006b3-9f1b-4cb4-aea5-01968e49013e tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad5c033f0d44534932d86c95fbff8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f41dfdc1e4e1aab41ccaae7afc9b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:14:38.790650 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-583006b3-9f1b-4cb4-aea5-01968e49013e tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] 10.222.0.35 "GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7" status: 200 len: 1757 microversion: 2.1 time: 0.194094 Aug 07 05:14:38.791196 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 727/1495] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:14:38 2021] GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7 => generated 1757 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:14:39.807938 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-bc4c0765-ce23-4c24-82df-e89d1f941d51 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:14:39.809259 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-bc4c0765-ce23-4c24-82df-e89d1f941d51 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] [instance: 59387c5b-f226-41d5-abfd-f64f7d3d2da7] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:14:39.815216 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-bc4c0765-ce23-4c24-82df-e89d1f941d51 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:14:39.815658 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-bc4c0765-ce23-4c24-82df-e89d1f941d51 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:14:39.816412 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-bc4c0765-ce23-4c24-82df-e89d1f941d51 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:14:39.817096 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-bc4c0765-ce23-4c24-82df-e89d1f941d51 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:14:39.938338 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-bc4c0765-ce23-4c24-82df-e89d1f941d51 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad5c033f0d44534932d86c95fbff8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f41dfdc1e4e1aab41ccaae7afc9b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:14:39.946037 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-bc4c0765-ce23-4c24-82df-e89d1f941d51 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] 10.222.0.35 "GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7" status: 200 len: 1757 microversion: 2.1 time: 0.141877 Aug 07 05:14:39.946596 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 769/1496] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:14:39 2021] GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7 => generated 1757 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:14:40.963479 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-8c2abd35-804e-4f28-b432-dd3654e9dead tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:14:40.964034 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-8c2abd35-804e-4f28-b432-dd3654e9dead tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] [instance: 59387c5b-f226-41d5-abfd-f64f7d3d2da7] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:14:40.970434 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8c2abd35-804e-4f28-b432-dd3654e9dead tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:14:40.970874 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8c2abd35-804e-4f28-b432-dd3654e9dead tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:14:40.973426 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8c2abd35-804e-4f28-b432-dd3654e9dead tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:14:40.973426 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8c2abd35-804e-4f28-b432-dd3654e9dead tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:14:41.090892 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-8c2abd35-804e-4f28-b432-dd3654e9dead tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad5c033f0d44534932d86c95fbff8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f41dfdc1e4e1aab41ccaae7afc9b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:14:41.098543 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-8c2abd35-804e-4f28-b432-dd3654e9dead tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] 10.222.0.35 "GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7" status: 200 len: 1757 microversion: 2.1 time: 0.138825 Aug 07 05:14:41.099096 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 728/1497] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:14:40 2021] GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7 => generated 1757 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:14:42.115350 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-13c8e70e-6fb3-4a58-864f-b65111d7c1d0 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:14:42.116008 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-13c8e70e-6fb3-4a58-864f-b65111d7c1d0 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] [instance: 59387c5b-f226-41d5-abfd-f64f7d3d2da7] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:14:42.121937 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-13c8e70e-6fb3-4a58-864f-b65111d7c1d0 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:14:42.122377 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-13c8e70e-6fb3-4a58-864f-b65111d7c1d0 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:14:42.123138 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-13c8e70e-6fb3-4a58-864f-b65111d7c1d0 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:14:42.123566 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-13c8e70e-6fb3-4a58-864f-b65111d7c1d0 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:14:42.244767 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-13c8e70e-6fb3-4a58-864f-b65111d7c1d0 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad5c033f0d44534932d86c95fbff8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f41dfdc1e4e1aab41ccaae7afc9b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:14:42.252674 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-13c8e70e-6fb3-4a58-864f-b65111d7c1d0 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] 10.222.0.35 "GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7" status: 200 len: 1757 microversion: 2.1 time: 0.141127 Aug 07 05:14:42.253263 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 770/1498] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:14:42 2021] GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7 => generated 1757 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:14:43.269667 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-687a0159-af47-4d0d-bf37-a508392518c6 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:14:43.270273 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-687a0159-af47-4d0d-bf37-a508392518c6 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] [instance: 59387c5b-f226-41d5-abfd-f64f7d3d2da7] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:14:43.276093 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-687a0159-af47-4d0d-bf37-a508392518c6 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:14:43.276537 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-687a0159-af47-4d0d-bf37-a508392518c6 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:14:43.278372 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-687a0159-af47-4d0d-bf37-a508392518c6 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:14:43.278811 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-687a0159-af47-4d0d-bf37-a508392518c6 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:14:43.401129 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-687a0159-af47-4d0d-bf37-a508392518c6 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad5c033f0d44534932d86c95fbff8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f41dfdc1e4e1aab41ccaae7afc9b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:14:43.409203 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-687a0159-af47-4d0d-bf37-a508392518c6 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] 10.222.0.35 "GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7" status: 200 len: 1757 microversion: 2.1 time: 0.143223 Aug 07 05:14:43.409759 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 729/1499] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:14:43 2021] GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7 => generated 1757 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:14:44.473050 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-67d37bce-9a5b-4812-9baf-bf4864a43628 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:14:44.473663 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-67d37bce-9a5b-4812-9baf-bf4864a43628 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] [instance: 59387c5b-f226-41d5-abfd-f64f7d3d2da7] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:14:44.479534 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-67d37bce-9a5b-4812-9baf-bf4864a43628 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:14:44.479980 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-67d37bce-9a5b-4812-9baf-bf4864a43628 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:14:44.480848 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-67d37bce-9a5b-4812-9baf-bf4864a43628 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:14:44.481289 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-67d37bce-9a5b-4812-9baf-bf4864a43628 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:14:44.608651 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-67d37bce-9a5b-4812-9baf-bf4864a43628 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad5c033f0d44534932d86c95fbff8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f41dfdc1e4e1aab41ccaae7afc9b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:14:44.616558 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-67d37bce-9a5b-4812-9baf-bf4864a43628 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] 10.222.0.35 "GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7" status: 200 len: 1757 microversion: 2.1 time: 0.147144 Aug 07 05:14:44.617159 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 771/1500] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:14:44 2021] GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7 => generated 1757 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:14:45.633852 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-f1efa0d0-b851-4670-978e-3b2fa77fb898 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:14:45.634542 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-f1efa0d0-b851-4670-978e-3b2fa77fb898 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] [instance: 59387c5b-f226-41d5-abfd-f64f7d3d2da7] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:14:45.641149 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f1efa0d0-b851-4670-978e-3b2fa77fb898 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:14:45.641588 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f1efa0d0-b851-4670-978e-3b2fa77fb898 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:14:45.642346 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f1efa0d0-b851-4670-978e-3b2fa77fb898 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:14:45.642773 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-f1efa0d0-b851-4670-978e-3b2fa77fb898 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:14:45.762390 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-f1efa0d0-b851-4670-978e-3b2fa77fb898 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad5c033f0d44534932d86c95fbff8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f41dfdc1e4e1aab41ccaae7afc9b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:14:45.770129 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-f1efa0d0-b851-4670-978e-3b2fa77fb898 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] 10.222.0.35 "GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7" status: 200 len: 1757 microversion: 2.1 time: 0.140022 Aug 07 05:14:45.770703 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 730/1501] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:14:45 2021] GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7 => generated 1757 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:14:46.787457 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-33ed88b5-d4d2-4d11-bea4-db59146eb1a8 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:14:46.788066 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-33ed88b5-d4d2-4d11-bea4-db59146eb1a8 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] [instance: 59387c5b-f226-41d5-abfd-f64f7d3d2da7] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:14:46.794479 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-33ed88b5-d4d2-4d11-bea4-db59146eb1a8 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:14:46.794926 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-33ed88b5-d4d2-4d11-bea4-db59146eb1a8 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:14:46.795730 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-33ed88b5-d4d2-4d11-bea4-db59146eb1a8 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:14:46.796166 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-33ed88b5-d4d2-4d11-bea4-db59146eb1a8 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:14:46.915563 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-33ed88b5-d4d2-4d11-bea4-db59146eb1a8 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad5c033f0d44534932d86c95fbff8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f41dfdc1e4e1aab41ccaae7afc9b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:14:46.924103 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-33ed88b5-d4d2-4d11-bea4-db59146eb1a8 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] 10.222.0.35 "GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7" status: 200 len: 1757 microversion: 2.1 time: 0.140540 Aug 07 05:14:46.924667 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 772/1502] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:14:46 2021] GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7 => generated 1757 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:14:47.940970 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-d5840777-f80b-48b1-916e-42d6ba8529f9 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:14:47.941531 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-d5840777-f80b-48b1-916e-42d6ba8529f9 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] [instance: 59387c5b-f226-41d5-abfd-f64f7d3d2da7] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:14:47.947363 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d5840777-f80b-48b1-916e-42d6ba8529f9 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:14:47.947796 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d5840777-f80b-48b1-916e-42d6ba8529f9 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:14:47.948549 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d5840777-f80b-48b1-916e-42d6ba8529f9 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:14:47.949855 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-d5840777-f80b-48b1-916e-42d6ba8529f9 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:14:48.068751 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-d5840777-f80b-48b1-916e-42d6ba8529f9 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad5c033f0d44534932d86c95fbff8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f41dfdc1e4e1aab41ccaae7afc9b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:14:48.077059 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-d5840777-f80b-48b1-916e-42d6ba8529f9 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] 10.222.0.35 "GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7" status: 200 len: 1757 microversion: 2.1 time: 0.139814 Aug 07 05:14:48.077621 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 731/1503] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:14:47 2021] GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7 => generated 1757 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:14:49.094753 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-5edd7720-d9e9-4168-ac39-2ad5fc90f7fa tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:14:49.095375 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-5edd7720-d9e9-4168-ac39-2ad5fc90f7fa tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] [instance: 59387c5b-f226-41d5-abfd-f64f7d3d2da7] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:14:49.101625 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5edd7720-d9e9-4168-ac39-2ad5fc90f7fa tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:14:49.102063 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5edd7720-d9e9-4168-ac39-2ad5fc90f7fa tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:14:49.102822 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5edd7720-d9e9-4168-ac39-2ad5fc90f7fa tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:14:49.103248 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-5edd7720-d9e9-4168-ac39-2ad5fc90f7fa tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:14:49.225352 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-5edd7720-d9e9-4168-ac39-2ad5fc90f7fa tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad5c033f0d44534932d86c95fbff8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f41dfdc1e4e1aab41ccaae7afc9b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:14:49.233335 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-5edd7720-d9e9-4168-ac39-2ad5fc90f7fa tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] 10.222.0.35 "GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7" status: 200 len: 1760 microversion: 2.1 time: 0.142499 Aug 07 05:14:49.233888 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 773/1504] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:14:49 2021] GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7 => generated 1760 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:15:52.631431 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-8dc522ee-d679-4eba-9e58-291be9012e7c tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-721822200"}} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:15:52.631940 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-8dc522ee-d679-4eba-9e58-291be9012e7c tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] [instance: 59387c5b-f226-41d5-abfd-f64f7d3d2da7] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:15:52.637970 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8dc522ee-d679-4eba-9e58-291be9012e7c tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:15:52.638962 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8dc522ee-d679-4eba-9e58-291be9012e7c tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:15:52.639739 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8dc522ee-d679-4eba-9e58-291be9012e7c tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:15:52.640171 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-8dc522ee-d679-4eba-9e58-291be9012e7c tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:15:52.759293 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.network.security_group_api [None req-8dc522ee-d679-4eba-9e58-291be9012e7c tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Removing security group f1998bdd-a871-4c7b-8c07-da9180cd2379 from port 51059a16-50f8-4560-ba4e-347c99d545d3 Aug 07 05:15:53.090191 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-8dc522ee-d679-4eba-9e58-291be9012e7c tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] 10.222.0.35 "POST /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7/action" status: 202 len: 0 microversion: 2.1 time: 0.463300 Aug 07 05:15:53.091962 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 732/1505] 10.222.0.35 () {60 vars in 1278 bytes} [Sat Aug 7 05:15:52 2021] POST /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7/action => generated 0 bytes in 466 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:15:53.102235 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: ERROR oslo.messaging._drivers.impl_rabbit [-] [addeaade-951f-4a1e-9d0a-4456063dc65a] AMQP server on 10.222.0.35:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 07 05:15:53.106192 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [req-ff88ff31-4f27-428d-b17a-b5d98e3a14c1 req-ddbb28bb-b67f-467c-8b1d-7dac84a0c88f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59387c5b-f226-41d5-abfd-f64f7d3d2da7", "tag": "51059a16-50f8-4560-ba4e-347c99d545d3"}]} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:15:53.108356 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 05:15:53.108356 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: warnings.warn(msg) Aug 07 05:15:53.115881 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-ff88ff31-4f27-428d-b17a-b5d98e3a14c1 req-ddbb28bb-b67f-467c-8b1d-7dac84a0c88f service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:15:53.116673 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-ff88ff31-4f27-428d-b17a-b5d98e3a14c1 req-ddbb28bb-b67f-467c-8b1d-7dac84a0c88f service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:15:53.146509 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.compute.server_external_events [req-ff88ff31-4f27-428d-b17a-b5d98e3a14c1 req-ddbb28bb-b67f-467c-8b1d-7dac84a0c88f service nova] Creating event network-changed:51059a16-50f8-4560-ba4e-347c99d545d3 for instance 59387c5b-f226-41d5-abfd-f64f7d3d2da7 on hv-cinder-80374 Aug 07 05:15:53.154514 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [req-ff88ff31-4f27-428d-b17a-b5d98e3a14c1 req-ddbb28bb-b67f-467c-8b1d-7dac84a0c88f service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053410 Aug 07 05:15:53.155129 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 774/1506] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 05:15:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 05:15:54.440014 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-34e24e8e-86fb-45b5-b80e-74fab59c593c tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:15:54.440587 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-34e24e8e-86fb-45b5-b80e-74fab59c593c tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] [instance: 59387c5b-f226-41d5-abfd-f64f7d3d2da7] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:15:54.446712 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-34e24e8e-86fb-45b5-b80e-74fab59c593c tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:15:54.447227 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-34e24e8e-86fb-45b5-b80e-74fab59c593c tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:15:54.448063 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-34e24e8e-86fb-45b5-b80e-74fab59c593c tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:15:54.448590 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-34e24e8e-86fb-45b5-b80e-74fab59c593c tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:15:54.459375 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO oslo.messaging._drivers.impl_rabbit [-] [addeaade-951f-4a1e-9d0a-4456063dc65a] Reconnected to AMQP server on 10.222.0.35:5672 via [amqp] client with port 56670. Aug 07 05:15:54.510932 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [req-81b91bc7-02e4-4548-8cd8-46fe626571fe req-bcd1f810-6434-47c9-82f9-e9ffd980765f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59387c5b-f226-41d5-abfd-f64f7d3d2da7", "tag": "51059a16-50f8-4560-ba4e-347c99d545d3"}]} {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:15:54.514402 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 05:15:54.514402 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: warnings.warn(msg) Aug 07 05:15:54.522917 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-81b91bc7-02e4-4548-8cd8-46fe626571fe req-bcd1f810-6434-47c9-82f9-e9ffd980765f service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:15:54.524579 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [req-81b91bc7-02e4-4548-8cd8-46fe626571fe req-bcd1f810-6434-47c9-82f9-e9ffd980765f service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:15:54.536707 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.compute.server_external_events [req-81b91bc7-02e4-4548-8cd8-46fe626571fe req-bcd1f810-6434-47c9-82f9-e9ffd980765f service nova] Creating event network-changed:51059a16-50f8-4560-ba4e-347c99d545d3 for instance 59387c5b-f226-41d5-abfd-f64f7d3d2da7 on hv-cinder-80374 Aug 07 05:15:54.541853 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [req-81b91bc7-02e4-4548-8cd8-46fe626571fe req-bcd1f810-6434-47c9-82f9-e9ffd980765f service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107580 Aug 07 05:15:54.542439 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 775/1507] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 05:15:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 05:15:54.543014 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.objects.instance [None req-34e24e8e-86fb-45b5-b80e-74fab59c593c tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lazy-loading 'services' on Instance uuid 59387c5b-f226-41d5-abfd-f64f7d3d2da7 {{(pid=107485) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 05:15:54.615967 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-34e24e8e-86fb-45b5-b80e-74fab59c593c tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] 10.222.0.35 "DELETE /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7/os-volume_attachments/f457996f-8a27-4f1c-812c-dce13711a2d5" status: 202 len: 0 microversion: 2.1 time: 0.183521 Aug 07 05:15:54.619258 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 733/1508] 10.222.0.35 () {58 vars in 1416 bytes} [Sat Aug 7 05:15:54 2021] DELETE /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7/os-volume_attachments/f457996f-8a27-4f1c-812c-dce13711a2d5 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:15:54.625851 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-92928fd9-b3ba-41cc-aec0-1c22d2a72ae2 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:15:54.627116 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-92928fd9-b3ba-41cc-aec0-1c22d2a72ae2 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] [instance: 59387c5b-f226-41d5-abfd-f64f7d3d2da7] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:15:54.634329 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-92928fd9-b3ba-41cc-aec0-1c22d2a72ae2 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:15:54.635048 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-92928fd9-b3ba-41cc-aec0-1c22d2a72ae2 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:15:54.636544 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-92928fd9-b3ba-41cc-aec0-1c22d2a72ae2 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:15:54.637016 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-92928fd9-b3ba-41cc-aec0-1c22d2a72ae2 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:15:54.679856 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-92928fd9-b3ba-41cc-aec0-1c22d2a72ae2 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] 10.222.0.35 "GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058207 Aug 07 05:15:54.680598 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 776/1509] 10.222.0.35 () {58 vars in 1302 bytes} [Sat Aug 7 05:15:54 2021] GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 05:15:55.692152 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-524b914a-06bc-4c4c-a062-22d5513d02c8 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:15:55.693302 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-524b914a-06bc-4c4c-a062-22d5513d02c8 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] [instance: 59387c5b-f226-41d5-abfd-f64f7d3d2da7] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:15:55.699455 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-524b914a-06bc-4c4c-a062-22d5513d02c8 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:15:55.699893 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-524b914a-06bc-4c4c-a062-22d5513d02c8 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:15:55.700755 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-524b914a-06bc-4c4c-a062-22d5513d02c8 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:15:55.701208 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-524b914a-06bc-4c4c-a062-22d5513d02c8 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:15:55.729133 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-524b914a-06bc-4c4c-a062-22d5513d02c8 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] 10.222.0.35 "GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040996 Aug 07 05:15:55.729590 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 734/1510] 10.222.0.35 () {58 vars in 1302 bytes} [Sat Aug 7 05:15:55 2021] GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 05:15:55.739629 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-632e60a0-75b2-4280-b12d-89788b737464 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:15:55.740153 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-632e60a0-75b2-4280-b12d-89788b737464 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] [instance: 59387c5b-f226-41d5-abfd-f64f7d3d2da7] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:15:55.745954 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-632e60a0-75b2-4280-b12d-89788b737464 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:15:55.746400 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-632e60a0-75b2-4280-b12d-89788b737464 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:15:55.747195 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-632e60a0-75b2-4280-b12d-89788b737464 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:15:55.747725 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-632e60a0-75b2-4280-b12d-89788b737464 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:15:55.822362 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.wsgi [None req-632e60a0-75b2-4280-b12d-89788b737464 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] HTTP exception thrown: Instance 59387c5b-f226-41d5-abfd-f64f7d3d2da7 is not attached to volume f457996f-8a27-4f1c-812c-dce13711a2d5 Aug 07 05:15:55.823010 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-632e60a0-75b2-4280-b12d-89788b737464 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Returning 404 to user: Instance 59387c5b-f226-41d5-abfd-f64f7d3d2da7 is not attached to volume f457996f-8a27-4f1c-812c-dce13711a2d5 {{(pid=107486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 07 05:15:55.823848 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-632e60a0-75b2-4280-b12d-89788b737464 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] 10.222.0.35 "DELETE /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7/os-volume_attachments/f457996f-8a27-4f1c-812c-dce13711a2d5" status: 404 len: 154 microversion: 2.1 time: 0.088109 Aug 07 05:15:55.824437 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 777/1511] 10.222.0.35 () {58 vars in 1416 bytes} [Sat Aug 7 05:15:55 2021] DELETE /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7/os-volume_attachments/f457996f-8a27-4f1c-812c-dce13711a2d5 => generated 154 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 05:15:56.957612 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-1af6b840-293f-4a4e-ae11-12d5270fe77a tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:15:56.958132 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-1af6b840-293f-4a4e-ae11-12d5270fe77a tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] [instance: 59387c5b-f226-41d5-abfd-f64f7d3d2da7] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:15:56.963809 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1af6b840-293f-4a4e-ae11-12d5270fe77a tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:15:56.964249 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1af6b840-293f-4a4e-ae11-12d5270fe77a tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:15:56.965031 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1af6b840-293f-4a4e-ae11-12d5270fe77a tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:15:56.965459 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-1af6b840-293f-4a4e-ae11-12d5270fe77a tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:15:56.989392 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-1af6b840-293f-4a4e-ae11-12d5270fe77a tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] [instance: 59387c5b-f226-41d5-abfd-f64f7d3d2da7] Going to try to terminate instance {{(pid=107485) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 07 05:15:57.063451 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-1af6b840-293f-4a4e-ae11-12d5270fe77a tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] 10.222.0.35 "DELETE /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7" status: 204 len: 0 microversion: 2.1 time: 0.109874 Aug 07 05:15:57.064232 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 735/1512] 10.222.0.35 () {58 vars in 1239 bytes} [Sat Aug 7 05:15:56 2021] DELETE /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 05:15:57.072689 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-51ea6936-a722-476d-ac98-a33340c04a18 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:15:57.076202 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-51ea6936-a722-476d-ac98-a33340c04a18 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] [instance: 59387c5b-f226-41d5-abfd-f64f7d3d2da7] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:15:57.082802 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-51ea6936-a722-476d-ac98-a33340c04a18 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:15:57.083275 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-51ea6936-a722-476d-ac98-a33340c04a18 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:15:57.084048 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-51ea6936-a722-476d-ac98-a33340c04a18 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:15:57.084478 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-51ea6936-a722-476d-ac98-a33340c04a18 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:15:57.203413 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-51ea6936-a722-476d-ac98-a33340c04a18 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad5c033f0d44534932d86c95fbff8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f41dfdc1e4e1aab41ccaae7afc9b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:15:57.210901 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-51ea6936-a722-476d-ac98-a33340c04a18 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] 10.222.0.35 "GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7" status: 200 len: 1555 microversion: 2.1 time: 0.142182 Aug 07 05:15:57.211453 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 778/1513] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:15:57 2021] GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7 => generated 1555 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:15:58.228956 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-9cc9e3e3-c205-40a7-897e-4405e8eeed93 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Calling method '>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:15:58.229647 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.compute.api [None req-9cc9e3e3-c205-40a7-897e-4405e8eeed93 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] [instance: 59387c5b-f226-41d5-abfd-f64f7d3d2da7] Fetching instance by UUID {{(pid=107485) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:15:58.235578 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9cc9e3e3-c205-40a7-897e-4405e8eeed93 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:15:58.236014 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9cc9e3e3-c205-40a7-897e-4405e8eeed93 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:15:58.236764 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9cc9e3e3-c205-40a7-897e-4405e8eeed93 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:15:58.237213 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [None req-9cc9e3e3-c205-40a7-897e-4405e8eeed93 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:15:58.355090 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.policy [None req-9cc9e3e3-c205-40a7-897e-4405e8eeed93 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad5c033f0d44534932d86c95fbff8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f41dfdc1e4e1aab41ccaae7afc9b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107485) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:15:58.362838 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-9cc9e3e3-c205-40a7-897e-4405e8eeed93 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] 10.222.0.35 "GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7" status: 200 len: 1555 microversion: 2.1 time: 0.137899 Aug 07 05:15:58.363389 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 736/1514] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:15:58 2021] GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7 => generated 1555 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:15:59.379535 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-68d759b9-97b2-4add-9797-6becb9afd7b8 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:15:59.380064 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-68d759b9-97b2-4add-9797-6becb9afd7b8 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] [instance: 59387c5b-f226-41d5-abfd-f64f7d3d2da7] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:15:59.385803 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-68d759b9-97b2-4add-9797-6becb9afd7b8 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:15:59.386239 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-68d759b9-97b2-4add-9797-6becb9afd7b8 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:15:59.386996 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-68d759b9-97b2-4add-9797-6becb9afd7b8 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:15:59.387418 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-68d759b9-97b2-4add-9797-6becb9afd7b8 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:15:59.509913 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.policy [None req-68d759b9-97b2-4add-9797-6becb9afd7b8 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad5c033f0d44534932d86c95fbff8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f41dfdc1e4e1aab41ccaae7afc9b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107486) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 05:15:59.518107 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-68d759b9-97b2-4add-9797-6becb9afd7b8 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] 10.222.0.35 "GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7" status: 200 len: 1555 microversion: 2.1 time: 0.142294 Aug 07 05:15:59.518676 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 779/1515] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:15:59 2021] GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7 => generated 1555 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 05:15:59.712010 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [req-2d3ffce8-0bee-4e75-a114-78a0e8598243 req-6b4f3d26-1c73-47db-b25d-8f4ce8a3c153 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59387c5b-f226-41d5-abfd-f64f7d3d2da7", "name": "network-vif-deleted", "tag": "51059a16-50f8-4560-ba4e-347c99d545d3"}]} {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 05:15:59.713620 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 05:15:59.713620 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: warnings.warn(msg) Aug 07 05:15:59.721111 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-2d3ffce8-0bee-4e75-a114-78a0e8598243 req-6b4f3d26-1c73-47db-b25d-8f4ce8a3c153 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:15:59.721647 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG oslo_concurrency.lockutils [req-2d3ffce8-0bee-4e75-a114-78a0e8598243 req-6b4f3d26-1c73-47db-b25d-8f4ce8a3c153 service nova] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:15:59.733052 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.compute.server_external_events [req-2d3ffce8-0bee-4e75-a114-78a0e8598243 req-6b4f3d26-1c73-47db-b25d-8f4ce8a3c153 service nova] Creating event network-vif-deleted:51059a16-50f8-4560-ba4e-347c99d545d3 for instance 59387c5b-f226-41d5-abfd-f64f7d3d2da7 on hv-cinder-80374 Aug 07 05:15:59.738319 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [req-2d3ffce8-0bee-4e75-a114-78a0e8598243 req-6b4f3d26-1c73-47db-b25d-8f4ce8a3c153 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029796 Aug 07 05:15:59.739076 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 737/1516] 10.222.0.35 () {64 vars in 1318 bytes} [Sat Aug 7 05:15:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 05:16:00.535432 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-97f78c9a-f3c6-4cb6-a711-a212365d6ef6 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Calling method '>' {{(pid=107486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:16:00.536367 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.compute.api [None req-97f78c9a-f3c6-4cb6-a711-a212365d6ef6 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] [instance: 59387c5b-f226-41d5-abfd-f64f7d3d2da7] Fetching instance by UUID {{(pid=107486) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 07 05:16:00.542375 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-97f78c9a-f3c6-4cb6-a711-a212365d6ef6 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:16:00.542820 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-97f78c9a-f3c6-4cb6-a711-a212365d6ef6 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:16:00.543586 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-97f78c9a-f3c6-4cb6-a711-a212365d6ef6 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 07 05:16:00.544020 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG oslo_concurrency.lockutils [None req-97f78c9a-f3c6-4cb6-a711-a212365d6ef6 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Lock "a0405fdb-5261-4cd0-aff8-05e581b9a634" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 07 05:16:00.558530 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.wsgi [None req-97f78c9a-f3c6-4cb6-a711-a212365d6ef6 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] HTTP exception thrown: Instance 59387c5b-f226-41d5-abfd-f64f7d3d2da7 could not be found. Aug 07 05:16:00.559110 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: DEBUG nova.api.openstack.wsgi [None req-97f78c9a-f3c6-4cb6-a711-a212365d6ef6 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Returning 404 to user: Instance 59387c5b-f226-41d5-abfd-f64f7d3d2da7 could not be found. {{(pid=107486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 07 05:16:00.559920 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO nova.api.openstack.requestlog [None req-97f78c9a-f3c6-4cb6-a711-a212365d6ef6 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] 10.222.0.35 "GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7" status: 404 len: 111 microversion: 2.1 time: 0.028238 Aug 07 05:16:00.560482 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: [pid: 107486|app: 0|req: 780/1517] 10.222.0.35 () {58 vars in 1236 bytes} [Sat Aug 7 05:16:00 2021] GET /compute/v2.1/servers/59387c5b-f226-41d5-abfd-f64f7d3d2da7 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 05:16:00.568829 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: DEBUG nova.api.openstack.wsgi [None req-37ebf641-c91b-4287-8a65-77cf71ed0746 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] Calling method '.version_select at 0x7f75ebd92430>' {{(pid=107485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 05:16:00.572553 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: ERROR oslo.messaging._drivers.impl_rabbit [None req-37ebf641-c91b-4287-8a65-77cf71ed0746 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] [27c8504b-c72f-4074-b647-1a287a42a87d] AMQP server on 10.222.0.35:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 07 05:16:01.589009 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO oslo.messaging._drivers.impl_rabbit [None req-37ebf641-c91b-4287-8a65-77cf71ed0746 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] [27c8504b-c72f-4074-b647-1a287a42a87d] Reconnected to AMQP server on 10.222.0.35:5672 via [amqp] client with port 56710. Aug 07 05:16:01.606070 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO nova.api.openstack.requestlog [None req-37ebf641-c91b-4287-8a65-77cf71ed0746 tempest-TestMinimumBasicScenario-142450843 tempest-TestMinimumBasicScenario-142450843-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1066780467" status: 202 len: 0 microversion: 2.1 time: 1.041242 Aug 07 05:16:01.606635 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: [pid: 107485|app: 0|req: 738/1518] 10.222.0.35 () {58 vars in 1272 bytes} [Sat Aug 7 05:16:00 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1066780467 => generated 0 bytes in 1043 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 05:16:12.869298 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 05:16:12.869823 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: Sat Aug 7 05:16:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 05:17:44.029293 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 05:17:44.029980 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: Sat Aug 7 05:17:44 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 05:18:42.227798 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 05:18:42.228416 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: Sat Aug 7 05:18:42 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 05:18:49.251702 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Aug 07 05:18:57.407616 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 05:18:57.408065 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: Sat Aug 7 05:18:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 05:19:13.463591 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 05:19:13.464139 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: Sat Aug 7 05:19:13 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 05:21:12.886683 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 05:21:12.887245 dv-cinder-803748-3-iscsi devstack@n-api.service[107486]: Sat Aug 7 05:21:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 05:21:19.254999 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 07 05:21:19.255591 dv-cinder-803748-3-iscsi devstack@n-api.service[107485]: Sat Aug 7 05:21:19 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!